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As reading ^lays a major role in the continuing 
education of a physician, relevancy to practice of the material 
selected by editors and ultimately read will theoretically result in 
an iiiiprovement of the continuing education process* If the selection 
criteria could be consistent for the writer, the editor^ and the 
reader, then the message has a better chance of attaining its 
objectives. It has been the aim of this contract to establish and 
test criteria which 6an enable the journals to more easily fill their 
role as the vehicles for conveying the message, and thereby to 
improve both the continuing education process potential and the 
resultant quality of patient care. This study addressed itself to the 
development and evaluation of criteria for use in assessing the 
clinical relevance of journal articles to the information needs of 
practitioners in several clinical categories, (Author/SJ) 
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A's reading plays V. major ro lo in the contjnujnt: c ducat ion d f 
a phv^ncian, reU-vancy to practice of the material scluctod by 
editors and ultimately read will thoore t i cal ly result in an im- 
nrnvemont of the continuing uducetion proces;-;, If the Kclcction 
criteria could bo consistent for tho writer, the editor, and the 
reader, tii^n the messaga has a better chnncc of attainin}. its ob = 
-i««tiv-s. it has hoen tiio aim of this contract to establiHli and 
tost crUcria which can enable thb journals to noro easil^- fUl 
their role a^3 the vehicles for convoyinB the iness'inc, and therebv 
to improve both tlio continuing education process potontjal and 
the resultant cjuality of put lent care. 

The conscientious medical prtict i tloner has alu'a>-B faced a 
formidable taslc in satisfying liis need and desire to remain abreast 
of current medical l<nowlodge. Jlis problem has been intensified 
by tho explosion of scientific knowledpo in recent years. The ac- 
comnanvins proiiforatlon of medical literature has broupht vith it 
new or broadcnad areas of immediate roluvanco to ivis practice. As 
a conaoquonce, the practicing physician is frustrated by hcvinn to • 
dovotc an increasingly d i s p r o p o r 1 1 on a t e aniount o-f bis available read- 
ing tine to. Kcrecnlng the mass of pubUshod material for those bits 
of inforniation most critical to his noed>= . 

. In an address to the Patient Care Section of the American 
Federation for Clinical Research, Lewis Miller and Hdward foidor 

te an apparent lack of positive relationship between the proliferation 
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of niodical litcraturG and its patignt care portincnce: 

"Communication in mQjicinu ha^^ rcmnincLl more ni' 
a traditional art than an c v o 1 \n n g s c i o tt cu? . 
Medical journalH in particular have been edited 
in the sanie stultifying pattoTn for decades. 
Progress has boon marked more by p ro 1 1 i'o r n M on 
than by portingnoo, and one cannot help but ' 
wonder wlio t:he r- = i n terms of im]irovod patient 
caro--^thc i-nf u rma t i □ n explosion in mo di c 1 no is 
contributing more to the w as to = paper pile tlian 
to sharpening tlie clinician's ability to prO" 
vide care for his patients." 

In addition to its rapidly increasing volume, the medical lit- 
erature confronts the average practitioner seeking clinicallH' rele- 
vant information with yet another problem. The va^t majeritv of 
published medical literature is intended prlmariiy to communicate 
horizontally rather than vertically; i.c,, tyi^ically^ communicn^ 
tion from academically or research oriented specialists to a limited 
audience of their peers, witli useful fallout to average front 
line practitioners viewed as little mere than an incidental 
objective, 

Miller and Folder underscore this observation and offer an 
explanutionofitsorigin;* 

I "Probably the primary defect of tlie traditjonal 

medical journal in this context is its inn'^ilit}' 

1 to bridge the gap between the producers o'- 

1 knowledge and tlio users of know 1 e dgc . . . /in c reason 

for this is tliat most medical journals are edited 
by and for the prDducers of knowledge rather than 

i and for tlie users. 

The medical author is usually motivated to pub- 
I licise tlie results of his particular studies 

I into specific diseaso entities or therapeutic 

modalities, lie wants to report what^s new and^ 
I hopefully, startlingly different. His writing 

I ' 

m bei-ris A. Miller and Edward A, Folder, M ./D.v '-Patient Care 

O ^ Orientation in a Journal'^; paper proscntod at tlie Patient Care 
jERXC SQCtionj Amorican Federation for Clinical Ilcsearch, Atlaiitic 
City, N. J., May S, 1968, 



is rowardyd by men working in his own field. 
'^■Q Is thorcforc inQro interested in i mt^ r c s i n g 
them than he. is in comniuni cat ing useful in.for- 
nuitioji to a wider audiDiice whoge interot^t in 
his ul) i e c t is radically d i f fr re n t f rcn that 
of his own peer |\roups . 

Medical uditors, too^ are j3artics to this process fperhaps char- 

ncterixaiDlc as a du facto conspiracy of ^M?eni^n neglect'^ to ■ 

uorrow a phrase from Daniel Patrick Moynihnnj for it is tlicy who 

rcgulatu^the production gates of tlic modical Ijtcrnturc nulls/ 

Miller and Fcidor seemingly concur witli tliis view and state: 

^'The modical editor is interested in jiuuntnlning 
the reputation of liis jour::al as one tliat carries 
the most weight in its field. Unfortunately^ 
^weight- is often defined as getting first 
crack at papers from outstanding authors in 
the field, not as serving the best interests 
of improved patient care* The medico] editor 
socks, as he should, to challenge the validity 
of statistical data, methodology and conclu- 
sions. Unfortunately, ho does not alwaj'S 
apply the same vigorous challenge to the value 
of the data and conclusions in tho. care of 
patients . " 

There is yet another dimension to the barriers orerating to 
thwart the information seeking be!\aviors of harried practitioners: 
a lack of effective mechaniBms to facilitate the screening^ identi- 
fying or di- f f oronti ating from the whole of tiiat fragnient of the 
medical literature which docs have immediate clinical relevance 
and potential patient care payoff. Uliile some'-j ournal s , cuch as 

t lent Carq , Modern Medicine , and Medical Uconomics ^ have attempted 
to improve the effective communication potential of tlicir publica- 
tions^ and still others such us the Now E n g 1 o n d Journal of Medicine, 
the Journal o f the Ameri can Osteopathic Association ^ and a few 
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othars innovated through the uso of abstract card< and variauH 

tvnnn oi: summaricH, no iniblicatLon has yat Qstablished stii table 

criteria to perniit tho i dunt i f i cat i cin of articles most rolovant 

to tho nlinical i n I'o r ina t i a n noodri of various prouns of practicing 

physicians. The Core Medical L i b r ary , e vol Opc d by Postgraduate 

Medical Institute (PMIJ, is one attempt to proscnt an organised, 

easily accessible set of !)OQks and journals encompassing the 

clinical practice of mu^licino, llowever, even tlii s highlv select 

collection ])rQsents a formidable amount of material ''□r regular 

and effective r e v : e \v . 

In an editorial welcoming t!io advent: of Abridged Index 

Modi cus the New Bngland Journal uf Medicine ventured that a succinc 

statomont of the problem would bo tliat, everyone complains 

about the medical literature, ^even those who issue it. It is too 

massivQ, too rcpotitive, too unmanageable ..."-^^ iNot content with 

mcroly highlighting the problem, and heralding Abrid ged- - Index 

Medi cus (AIM), NLiJM concluded that additional efforts still were 

indicacod and coined tlie phrase ^'committed selection" to label 

a diroction which warranted further research ^and deveiopinent: 

"...Alleviation of all these stigmata of mon- 
strosity is not easy, but one feasible apprDach 
is tliat of 'coinmittod selection.^ Someone has 
to stick out his neclc and saVj U.ook^ here is a 
selected and convenient list of reading matter 
that we recommend,^ The recommendation cannot 
be guaranteed as optimumj and it certainly re- 
quiros continuous review . Yet the principle 
should be vigorous ly applied in several direc- 
tions . A good example of sucli an application 
is the identification by Stearns andRatcliff 



Committed Scloction: Abridged Index Medicus (editorial), New 
Ungland Journal of Medicine, Vol, 2S", Ko . 4, Jan* 22, 1970. 

; it 

StGgirns, U.S., S Ratcliff, Iv . W , A Core Medical Library for 
jV>" Prfictitioners in Conimunity Hospitals, New Enniand JournPl nf 
^ Mcdrcinc, Vol. 280, 1070, pp. 474^480 



of r\ core library. The opinioris of tho NAS-NUS 
pHnols concerning the usofulnoHs of certain anti= 
biotic prcparat i on^ i s anothor instance of 
nn^mm it ted Hclectiun — controversial, not infrU. 
b 1 c , but unavoidab 1 e . MM now cont i nuoH t h i h 
usoful tr .id, Clearly, comnilttcd selection k1 1 1 
liavo to bo applied olsewhuro: to the idcntjfi = 
cation of ou t s t uiiu i n and useful a r 1 1 / J ns in 
given clinical catogorios, 



It is to tho last point tliat the current ^^oject ha^ licon 
addressod:^ tlic devclopincnt and evaluation of critcrin for u^o i 
assessing the clinical rclcvanco of journal rrticlei^ to the info 
mation needs of practitioners in several clMUcnl cntej:ories. 

HowevGr, in contemplating the development of a system of 
criteria to evaluate the clinical, relevance of journal articles, 
one must imiiiediately consider tlie consumer group or typo of 
reador to whom it is hypothesised that use of tho criteria to 
identify high priority literature will bo a useful service. 
Clearly, it is quite possible that there may be considerable 
variation in the value to be assigned to the clinical relevance o 
a given article when considered in the context of tho potentially 
varying information needs of different t>^pcs of prac t i t i one rs : 
i.e,^ generalist vs. specialist; specialist fpedi atri cian) vs , 
specialist [internist]; and s ub s pec i a 1 i s t ( in t e rn i s t - car d i o 1 o g i s t 
vs. subspecialist C i n t e rn i s t - ondo cr i n o 1 og i s t ) , Jt may follow 
then, that some limitation of target populations may be indicated 
particularly during developmental phases. 

Miller and Felder suggest the family physicians as the group( 
of practitioners with perhaps the greatest need in the area of 
literature identification helpr 



"This dofcct is most upparent when wo look- at 
thg largost hoinogunoous grou]3 of medical readei*s-- 
the family physicians, or pcnor a 1 pi^n c t i t i on o rs 
and goneral internists in private practice, Tlijs 
group provides tlio bulk o f f 1 r s t = 1 i nc patJcnt 
care in this countr\'. 

Tho family physician is responsible for a wide 
range of clinical decision- making in mod i cine. 
At tlio same time, lie has to make these decisions 
about m.o re patients in less t i mo tli an mos t 
specialists, with the possible exception of the 
pod i a t ri c i an . 'fh e family doctor also roc c i ve s 
more medical literature-unsolicited and unsoli = 
cited--than most of Iiis specialist colleagues. 
Yet most of what lie receivos is not iiearcd to 
his specific needs i ji day-to-day prac t i ce . 
Articles are gcnGrally disoaso oriented, not 
patient oriented, and provide fragmented infor- 
mation. not easily integrated into the care of 
the whole patient J' 

If one also adds tlie broad specialty classifications of 
pediatricians, ob s t e t r i c i an s / gy ne co 1 ogi s t s and general surgeons, 
to the family Cgeneral) practitioners and internists suggested by 
iMillar and Felder one may define a larger and somewhat more sig- 
nificant patient care practitioner cluster: the Primary Physician, 
or that group of physicians who collectively have initial contact - 
wg.th most patients and to whom patients commonly turn (frequently 
without regard to the specialty classification) with a problem that 
requires initial evaluation, diagnosis, treatment and/or referral. 
The reasons for a patient w'ith a sore throat, vague pain, etc., 
turning to the old family pedl a t r i c5 an j obstetrician ^ or general 
surgeon, and in effect using those specialists as family physicians 
ai*G too numerous to consider here, The . important thing is that 
the behavior does, in fact, occur and sometimes frequently. The 
im.pl ications of the plienomengn are th.at siicli specialists must be 
able to function in the capacity of primary physician as well 'as 



specialist and, consequently, show certain common information 
noods in addition to tlic unique ones thoy have concomitant with 
their differing roles as s no c i a I .i s t s , It foUoKS, tlinn, that ' 
all such potential "primary physicians" iiiust keen ahreast of current 
clinical information in many areas otlior than their specialties. 
Iloro lies the crux oi: tlio problciii. liow docs that busy practitioner 
oven keep in touch with all of the potential sources of relevant 
info r m a t i 0 n , no less !5 o able to screen, select, rend a n d 
evaluate that iii a t c; r i a 1 ? 

Clearly, and as advocated by the Km^ Hngland Journal of 
Medicine, "someone has to stick out hU nock" and make rccommen= 
dations. But such recommendations would bo more accoptable to 
all parties concerned (producer, consumer and repulators of the 
literature) if based on a sot of criteria, rationally derived and 
empirically tested. ivith this ncod as a focus, activities under 
the current contract wore directed toward developing and testing 
a system of critaria to guido the evaluation of the clinical rele= 
vance of an individual joL/rnal article relative to the sepnratc 
clinical inforination needs of each of five types of specialists 
CGeneral Practitioners (G) , Internists (I), Pediatricians (?) , 
ObstQtrician/Gynocologists (O), and noneral Surgeons (S) }, as 
well as relative to their common clinical infortnation needs as 
potential primary physicians (GIPOS) . 

Postgraduato Medical Instltu-te CPMI) received Contract 
NIH 70-4042 ("Conduct a study for journal article selection rele- 
vant- to clinical medicine") in Fobruary of 1970. This is the 
final report of activities conducted under the contract and find- 
ErJc""^ obtained. 
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f-ducation 
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CStatistics) , Boston University School of liducation 
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Peter Angleo, M.D.. Waltham Hospital, Waltham, MA 
Francis h. Barcus, Ph. D., Associate Professor of Communi- 
cations Research, Boston Univcrsitv Scliooi of Public 
Communications, Boston, MA 
Arnold Brill, M.U., Waltham Hospital, Waltham- MA 
Richard Gleckman, M.D., Senior Phvsician, Fomuol ShnttucV 
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Donald Glotzor, M.D., Assoc. Professor of Surgerv , 

Beth Israel Hospital, Boston, MA 
George Grady, M.D., Director, Division of Biological 
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'^'^DivLff^'^u'-" of Infectious Diseases ■ 

Division, University Hospital. Boston M.\ 
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Lngland Medical Center Hospitals, Boston M4 
Clement Smith M.D., Oditor, Pediatrics , Boston, MA 
LOU.XS Wemstein, M.D., ProfcsiFF of UelUine . New 
Lngland Medical Center Hospitals, Bostcn/MA 



METHOD 

I. Study Design and Do ve 1 opmon t 
^' Criteria Establishment 

An iniUal activity specified in t„e contv„ct cuilod 

PMI to: 

"establish proliminary criteria for the silec 

eral Surgary, and Ob s te t ri cs ^Gyneco 1 ogy : - 

Pursuant to impUmonting this charge, PMT rocruited . V • 

h i recruiLed a distinguished 

»ail sroup Of senior editors, editorial board „e.bers. ,cade.i- 
cians, and =o«unity hospital practitioners to assist ,,ith t„e 
pre.survey tas^k of "estaMishing preliminary criteria'^ as specified 
above. AS noted in t„e introduction ,o this report, the ,roup „as 
selected in such a .ay as to per„.it representation of the points 

of view of producers, consumnrs 

, consumers, and regulators of medical litera 

-re („iters, readers, and editors,. , roster of the individual: 
included in .his .r„„p appears en the contract personnel pa.e under 

the heading: "Clinical Relevann.- ,„-i r> • 

ielevance and Project Developnent Consultants 

. An outcome of the group's deliberations «s an oipbt iten, 
-iteria syste. designed to guide the evaluation of the clinical 
relevance of an individual journal article relative to the sepa- 
rate Clinical infor«,tien needs of each ef the five types of physi- 
cians Of concern to the study (General Practitioners (C) , Intern- " 

CD,, Pediatricians (P) , Obstetri clans - Gynecologl s ts (0) 
•nd General Surgeons. CS^ ). as well as relative to their co«o„ 
cunieal information needs as potential primary physicians (CIPOS, 



ThG key feature of the system is that it permits the evaluation of 
the clinical relevance of an article in a journal such as Pediatrics 
for (G) , (I), (0), and (S) practitioners as well as for pediatric 
cians, i.e., a given article can be differentially evaluated rela- 
tivG to the clinical information needs of the five separate types 
of specialists under consideration in the study as well as relative 
to the general needs of ''primary physicians''. 

Details of the criteria system, the article evaluation in- 
struments into which it w.^s incorporated ^ and its uses are dis- 
cussed in appropriate sections below. The eight potential 
criteria formulated for use and examination in the study are as = 
follows : 

1, Topical interest of article to each audi en ce ( i * e . , how 
timely is the subject); 

2, Compr jhensibility of article to each audience (i-e., not 
dependent on specialized knowledge); 

3, Frequency of applicab i J i ty of article^s information to 
the clinical practice of each audience (i.e., how often 
will the information be used); 

4. Significance of article's information to ths^clinical 
practice of each audience (i.e,^ potential impact on 
care of individual patients) ; , 

5 . Ad equacy of article *s back ground explanation for each 
audience (i.e*, how well is the topic area explained); 

6. Originality of article^s information (i.e., how new is= 
the knowledge) ; 
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7. Validity of article^s information (i,©,, are statements^ 
claims and conclusions well supported);' 

8. Quality of writing (i.e., style, as distinct from com- 
prehensibility) , 

B . Study Revision 

During preliminary phases of Criteria Establishment, questions 
were raised by PMI staff members and consultants regarding the 
efficacy and desirability of the study*s design as defined in the 
original scope of work. The problemj as independently identified 
by several of the Consultants and PMI staff members, centered 
on the possibility that even if the study were implemented exactly 
as prescribed in the original scope of work, it could still 
yield data of only limited utility. The number of articles po^ 
tentlally to be reviewed Capproximate ly 7200 in 20 journals) was 
so large that it was possible and even likely that there would be 
little or no overlap among the lists generated by the independently 
operating judges. In essence, potentially too many articles 
were to be reviewed by too few rcyiewers under conditions that 
did not assure that data produced would be statistically meaningful, 
PMI consultants and staff members agreed that an attempt to 
"tighten-up'' the study was indicated in order to maximize the 
probability that it would achieve its goals. 

Details of the study design probleni were reviewed with the 
thon Project Officer. Ho authorized PMI to proceod with an appro- 
priate reformulation of tlio study's design concurrently with de- 
volopmQnt of materials needed to obtain Bureau of the Budget (B-O-B) 
clonranco for the ques tiannairo forms to be used in the study. 
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PMT immediately began to work on the reformulation of the 
study design as well as the B-O^B submission materials, A ro- 
port of progress containing a preliminary revision was submitted 
to the then Project Officer on May 6, 1970 , together witli 25 
pages of material pertinent to obtaining 13-0^B clearances ♦ Tlic 
report indicated that several additional refinements were likely 
before the study design was finalisod. - 

All necessary cliangos and additional materials we c completed 
in the next month. A final 94 page compendium of B-O'-B submission 
materials was transmitted to the Project Officer on June 26, 1070. 
By that time arrangements had also been made to meet with the 
Project Officer early in July to review the final revisions in the 
s tudy des i gn , 

On July 1, 1970, the Medical Coordinator and Evaluation Co* 
ordinator presented an outline of tiie revised study design in final 
form to the Project Officer at his office in Bethcsda, Maryland. 
A summary of the Revised Study Design is outlined below. 



Revised Study Design 



In summary form^ the revised study design called for: 

A* I'O journals; 2 from each of the five specialty fields 
in the s tudy . 

B. Three groups of articlc-cvaluators : 

10 editors, one from each of the 10 journals 
100 academician practitioners, 20 froin each of the 

spocialty fields in the study 
100 community liospital practitioners, 2 0 from each 
of the specialty fields in tlie study 
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Tlie clinical relevance o£ all articles in a single 
issue (c.g*, November, 1970) of each journal would be 
evaluated, in turn, by tlie editor, and 5* academician 
practitioners, each working independently. Each of 
these cvaiuators would use the PMI criteria syston as 
tlie basis of tlieir evaluations* 

Parallel to C, and at the same time, groups of 5** other 
academician practitioners would evaluate the clinical 
relevance of the same articles without the use of the 
PMI criteria system. (That is, they would bo asked to 
make the same final judgment of each article for the 
various target audiences in the study (a recommendation 
for priority ("must'') reading), but they would not have 
the PMI criteria system to guide their judgments. In- 
steady tliey would be asked to specify the criteria they 
developed and used on their own O 

Following completion of the editor and academician survey 
phases of tlie study, participnnt response, including 
both quality and quantity o£ data produced, would be 
assGSsed. If experiences with the first two survey 
phasGs indicated, a third survey phase (utilising non- 
academic, community hospital practitioners) would be 
conducted replicating the pattern followed, and tasks 
performed, during the academician survey phase. (That 
is, subgroups of 5 community hospital practitioners, 
half with and half without the PMI criteria, would 
evaluate the same material evaluated by the academicians 
and editors . ) 

The data produced in all three survey phases would then 
be analysed to examine several questions: 



The large groups of 100 academicians and 100 community hos]iital 
practitioners would consist of groups of 20 drav/n from each of the 
five specialties of interest in the study. Of each group of 2o 
specialists, 10 would be randomly assigned to evaluate one of 
two journals from the specialty field* The remaining ten would 
be assigned to the second journal* The groups of 10 specialists 
assigned to evaluate 'each journal would be^fuTthor divided 
randomly into sub-^groups of S each* JIalf of the resulting pairs 
of 5 member sub-groups would use the PMI criteria system to 
evaluate the articles in tlie journals as specif ind in J'he 
other half of the 5 member sub-groups would evaluate tlie same 
articles without using the criteria, as specified in D, 

Size of sub-groups was detormined by considerations of the re- 
quirements of statistical procQduros to bo used during data analysis. 
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1. Do editors, academicians, and communitv hospital 
practitioners have the same or differing perspec^ 
tivcs on ^'clinical rclovance^S i,e., do'^they seloct 
the same material or different material when pickin 
articlDs that they judge to be clinically rolDvant? 

2. Does the PMI criteria systom facilitate making con- 
sistent judgments of clinical relovanco, i.e,, is 
there greater Intor-group reliability among users 
of the system than among those who had to rely on 
their own criteria? 



5, Does the system as a wliole, or parts thereof, have 
valid predictability in terms of an cvaluator^s 
overall judgment of an article's clinical relevance? 

4. Does the criteria system facilitate making differen- 
tial judgments of a given article^s clinical rclc^ 
Vance to more than one specialty, particularly with 
respect to identifying potentially valuable articles 
for one specialty that may be published in another 
specialty's journalCs)? 

In addition, the articles identified as mo^t clinically 
relevant would be used to **explore educational and 
patient care use to which a core collection of current 
journal articles relevant to practice could be put and 
to provide examples of such uses a? specified 

in the contract scope of workj e.g., as a source of 
content material for questions to bo used in knowledge 
asseSHment ox.aminut J ons by practitioners. 



C . X ns t rument s 




n, a limited 



number of prc-solocted articios wcrQ to ho evaluated by 5 sub= 
groupn of judges as follows: 

1* liditors using critoria 



Community ilaspital Practitioners using criteria 
Comniunity llospital Practitioners not using criteria 



Two distinct instrumonts, one specifying the PMI criteria and the 
other omitting them, were developed for use ns article evaluation 
forms by those groups of judges. (Scq Appendix AJ 



ARTICLE [^VALUATION I-OUM CCRLS 431 was designed 
for use by groups 1, 2 and 4 above. The form 
was designod to permit a judge to evaluate a 
single article, on six-point scales, for each 
of the six target populations o£ concern to 
the study (G, I, P, 0, S, GJPOS) on each of 
the parameters of the eight separate PMI cri- 
teria. In addition, the form provides a space 
for the judge to make an ^'overall assossmonf 
of the articles for each target populatjon (a 
yes or no recommendation for prioritv f'^must^*) 
re adings 1 . 

ARTICLE liVALUATIQN FORM (CRLS 63) was designod 
for usq by groups 3 and 5 abS^e . CRLS 63 to- 
quires tho judge to make the same "overall 
assessment" of the article (as described An 
CRLS 43 above) but iieithcr specifics the 6 PMI 
critGria nor requires the rating of tho article 
on each of the criteria. Instead tlio article 
provides space and instructions nskinn the judge 
to spocify what critoria ho, himsol f /' f orinu^ 
iatod and/or used as a basis for making his 
"overall assessment" rating; i,o,, it bpHs him 
to list the criteria he utilised to evaluate 
the clinical relevance of the article. 



2, 



Academicians using criteria 



3, 



Academicians not using criteria 



A third instrument, described bolow and also included in Aiipciulix ^ 
was developcj for use as a debriefing instrument on whicli judges could 
racord their reactions and s ug go s t i ons af t e r using the PMI criteria 
system* 

APPRAISAL OF ARTICLi£ liVA LUATION SYSTHM (C RLS 35) was designed 
for use by sub grcups 1^1 and 4 above, /rho Form was dc'signod 
to permit a judge to recoi'd systematically li is ' react i ons 
to the criteria system after liaving used it to evaluate the 
articles' assigned liim. In a series of '■open-ended^' and 
"yes-no plus explanation'' questions the fDrm queries the 
judge's opinion regarding additions, deletions or modifi- 
cations of the system j etc. 

In addition to tlie three primary survey instruments described above ^ 

a number of materials wore developed for use as standardized mailings to 

the various subgroups in the study. Tliree classes of standardized mailing 

materials were developed and used to facilitate recruitment, orientation 

and task specification for the various subgroups of participants in the 

study. The three classes of materials included '*Cover Letter", "Intro-. 

duction to Participants" and "iNon-Respondent Followup Letters". 

COVER LHTTOR elicits participation of prospective sub- 
jects in the study and/or acknowledges previously 
obtained verbal agreement to part i ci pat o ^ and defines 
tasks to be performed and procedures to be fellowcd. 
Cpersonalized letter with hand signature) 

INTRODUCTION TO PAnTlC IPArVS explains tlie background and 
purposes of tlie study (two page mimeographed form). 

NUNRHSPONDHNT POL L OWUP LirrTHR reminds nonre spondent of the 
piirposc of tlie s tudy ^ It is agreement to parti cl pate , the 
specific tasks to be performed, and the urgency of prompt 
complGtion of the task (personal i zed letter wltl^ liand 
s ignature) , 

App rop ri at e 1 y modified versions of those three general cl as s es of 
materials' wo:^e developed and used during the survey pliases of the study, 
i.e., separate versions of the "Cover Letter's "Introduction to Partici- 
pants", and ''Non-Hcspondent Followup Letters" were tailored to the various 



subgroups of participants (editors, acadGmicians using criteria, academ- 
icians not using critoria, Gtc). A complete sot of the standardizcci 
mailing materials was submitted for revioK and app r o v a 1 , a 1 on g with the 
study's survey instrumonts and proceduros, by tho Bui-oau of the Budget. 
Sample sets of the standardized nuiiling materials Ctlosigned for use with 
tho two academician subgroups) are included in Appendix A of this report. 



IS 

1 1 . Study Iinplemontation and Procedur e s 

I-npJ.ementation of the rcvisod study design is outlinod below. In 
tho format utilizod, tho design of each step in the studv \^ sumrrAri ::od 
and then is followed by a detailed statement of its i mp 1 omen t at i i 



on 



Step 1_ -Design : 

Selection of tan journals, 2 reprcsontinp each of the five major 
fields of interest to the study, i.e., general practice (G), internal med- 
icine (I), pediatrics (P), obstQtrics^gynccology (0), and general surnnry 
(S) . 

Step 1 - Implementation; 

Stop 1 was completed by July 1, 1970. Journals seloctcd and the 
fields they represent are as followa: 

general practice Amoricaii Family Fh vs i c i an / P 

Now linfila iid JmirnaTl of Medicine 

internal medicine Annals of IntcrnaJL Medicin e 

Amcrl can d'ourna l ,of ffedi cine 

pediatrics Pediatrics - 

J ourn al of Fed i a t r i c s 

obstotrics-gynecology ObsjEo t ri cs jin d Gy n ecol etzy 

American J ournt\l of^ Obl' fi Cy n . 

Bencral surgery Annals of Surg e ry 

it^vg oTy , Gynecology , C^ Obstetrics 

Journal selGction and field assignment were made on the basis 
of their inclusion on the list of iournals recommended for "A Core Medical 
library"*, and on tho basis of data from a prior PMI survey of the incidence 
of G,1,P,0, AND S physician s p cc i a 1 i s t s ' r cgu 1 ar reading of various medical 
journals among the doctors at a number of New Hngland hospitals. Journals 
selected represented those most frequently read by tlie five types of speci..;.- 
.ists in the study. In the few instances whore the same journal (e.g., N'fJM) 
appeared in tho top two of more than one specialty's list of most frequently 
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road journals, tho journal in question was assigned to only one specialty 
and was replaced in the other specialty by the next most frequently citod 
journal. jama was the only eligible journal not included. This was due 
to the fact that AMA editors had stated an unwillingness to cooporato with 
the study during earlier phases. 

Step 2 - Dj^sign: 

Recruitment, as participants in the study, of the editor of each of 
the journals selected for inclusion in the study. 

Ste p 3 - implement ation : 

Stop 2 was initiated in July, 1970 and was success ful ly completed in 
early fall. Senior editors of nine of the journals agreed to participate 
fully In the study. Tho tenth senior editor at first agreed to partici- 
pate himself and later asked that his associate editors- be allowed to sub^ 
stitute for him. Several other senior editors asked that their associate 
editors be allowed to participate in addition to themselves. All requests 
were happily honored as they appearod to present no significant research 
problems. Inclusion of associate editor, raisod the total number of 
"editors" participating in the study to IS. as indicated in the Results 
Section, 

liditor recruitment was accomplished through in-person visits to the 
aditors by the Project Director, Modical Coordinator, and Evaluation 
Coordinator. Personal =vis it recruitment proved a fortunate choice in the 
case of the editors, whose participation was vital to all other phases of 
the study, because it allowed the PMI recruiters to handle issues that 
arose such as the possible long range throat of the study or its outcomes 
to such things as editorial prerogative. In addition, the editors (most 
of whom are also quite concerned with issues of how to maximise chances 

ERIC 
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of getting the right information to the right pGople) provided much val- 
uable information regarding the problenns of identifying or generating 
clinically relevant literature. The discussions also allowed a number of 
the editors to review the details of the study *s design and their roles 
in it. In. a number of cases the rigor of the study's design or its poten 
tial for providing comparisons of the "clinical relevance" perspective of 
editors, academicians and practitioners seemed to be of particular interc 
to the ed i tors . 

Editors were advised that the actual survey (article evaluation) 
phase of the study would begin as soon as PMI roceived Bureau of the 
iBudget Clearance, 

Step 3 - Design: 

Selection and recruitment, as parti cipants . in the study, of 100 
academically-oriented practitioners (20 from each of the 5 specialties 
I, P, 0, S, in the s tut 



Step 3 - Impl ementation: 

Selection and recruitment of the academicians began in July, con- 
currently with the recruitment of editors, and was successfully completed 
in December , 

Potential candidates were picked random from lists of Boston-area 
physicians prominent as both educators and practitioners, and as reviewers 
of material submitted for publication or as contributors themselves, Listi 
of 20 or more potential candidates were ass^embled for each of the five 
specialty groups in the study. 



Q Stearns NS, Ratcllff WW: A coro medical library for practitioners 
ERjt community hospitals. NGJM 280:474-480, ia60\ 



Between July and December the Medical Coordinator porsnnaJly 
• telephoned and recruitod each of the potential candidatns. Onlv n 
few potential candidatos actual ly. declined to pa r t i c i pat e . wh en 
invited, but many wore very hard to roach beciuise of their busy 
schedules. Fortunately, little time was actually lost duo to the 
extended recruitmont period because most of it occurred while PMI 
was awaiting B-0=B clearance for the survey forms: 

On actobcr 20, 1970, the then Project Officer advised PMI that 
B-O-B clearance for the survey questionnaires (article evaluation 
forms) had been granted and that tlse actual survey phases of the 
study could commence. 

All forms requiring the B-O-B cloarance number, etc, were 
inimQdlately sont to the printer. Orders were placed for 20 copies 
each of the currant issue Cfirst in November) of all. journals ,in the 
study. AH other nocossary stops were taken to permit mailing of 
complete work phasrs survey packets to editor and academician 
participants as soon as matorlals bocatno available, 

Step 4 - Design ■ 

liditors apply and evaluate the Clinically Relevant Literature 
Criteria System under controlled conditions. 

Step 4 - Implementation : 

Survey packets containing al 1 nocossary materials and instructions 
wore moiled to all participating editors by November 25, 1970. Packets 
cbntainod individually typed cover letters containing compJete 
ms' '-ctions, a short background paper CINTROPUCTION TO J'Ak T I C J PANTS ) 
on tii... study, enough ARTlCLii liVALUATlOK FORMS (CRLS 43) to evaluate 
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each article in the designated issue of the Journal, an APPRAISAL OF 
ARTICLE liVALUATION SVSTHM FORM (CRLS 23), and postage paid return 
mai lo rs . Sanip 1 es of all these docunicrrt s are included in Append 1 x A , 

Completed materials wore returned to PMl by all editor 
participants by the end of the first weok of January^ 1971. As 
indicated earlior, several associato editors also submitted materials 
All data returned was of excellent quality. All data was visually 
inspected and then stored for later data analysis. 

rhank=you letters and honoraria were sent to all participants. 

Step 5 - Pes ign : 

Academician-practitioners apply and evaluate the Clinically 
Relevant Literature Criteria System under controlled conditions. 

Step 5 - Implementation: 

Implementation of the academicians survey phase began concurrent- 
ly with that of^the edicors. The 100 academicians were mailed 
packets similar to those sent to editors, but with the addition 
of an actual copy of the journal issue to be evaluated. Delays in 
receiving shipments of the necessary journals at PMI caused delays 
in the mailing of survey packets' to some participants. Most packets 
were mailed in December and tlio remainder went out in early Januai^y, 
1971 , 

« 

Groups of ten academicians' evaluated the 10 journals^ one group 
^per journal. Half of each group of ten used the PMI Criteria System 
(see form CRLS 43 in Appendix) to give articles ratings on each 
criterion as well as overall (a yes or no recommendation for prjority 
''must'' reading). The other half were asked to make the same overall 



rating but to supply their own criteria (soe form- CRLS 63 in 
Appcnrlix A, 

A return flow of coinpletod materials started arriving at PMI 
in Decombor and continued through tho first quarter of 1D71. During 
that time two soparuto non = respondcnt foUow^uns Clotter) wore 
initiated by PMI at appropriate tinios according to the plan outllnod 
in 3 = 0=^13 submission inatorials. UUiinatoly, completed materials 
wcro returned by over 1S% of the .cado.icians who originally agreed 
to participate in the study. As with the editors the data was, for 
the most part, of excollont quality. The 75^ return was abovo the 
minimal level needed for effective data analysis. 

Thank-you letters and honoraria were sent to all participants. 



As indicated earlier in the Study Design Summary, the quality 
and quantity of data produced during the first two survey phases of 
the study (editors and academicians) were to receive a preliminary 
roviaw and assessment before proceeding with the third survey phase 
(community hospital practitioners). The review had to be delayed 
until late spring 1D71 because of delays in getting completed 
materials returiiod by some academician participants.. When the out- 
comes of the first two phases were reviewed the data finally produced 
appeared to be quite satisfactory in both\ quality and quantity, i.e., 
tho results produced were quite good though slower in coming than 
expected . 

Steps were then undertaken to initiate the third and final 
survey phase. 
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Step 6 - D esign: 

riol«ction and recruitment, as participants in tho study, of 100 
community hosp i t al -o ri ent □ d practitioners (20 from oach of tlu 
specialties CG,I,P,o.S3 in tho study). 



IG b 



Step 6 - Jmplemontation : 

Solo.tion and recruitment of tho community hospital practitioners 
began in May. 1971 and was successfully complotod in July. 

Potential candidates wore pickod at randon, from tho listings of 
board certified Massachusetts I.P.O and S spocinlists. Eligible 
candidates wero limited to those whoso listines indicated conmunity ' 
hospitals as current primary affiliations. Individuals excluded 
were those with prinmry medical s chool /teaching hospital affiliations, 
or academic rank above clinical associate. The current edition of 
the Directory of Medical Specialists did not contain listings of 
the American Academy of family Physicians (G specialist). A sub= 
stitute list of appropriate candidates was obtained from the 
Massachusetts chapter of the American Academy of General Practice. 

Two page personal rocruitment letters, were sent to over 250 
potential candidates. Almost 150 responded affirmatively. Affirmative 
rospondors wore well distributed amons the five specialty groups. 
Written confirmation that their practlcos were primarily community 
hospital/office^orientod (a, opposed to medical s ch oo 1 /un i ver s i ty 
Hospital or other=oriontedj was obtained from each candidate 
recruited. 



Ste p 7 - Desi ;.nj_ 

Community hospi tal -practitioners apply and evaluate tho Clinically 
Relevant Literature Criteria Svstom under controlled conditions. 



I 
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I 

^ :? 

I 

^top , , I I oment a t i o n .' 
j implnmontation of the community hos p 1 1 a I ^ p ra c t i t i on o r survey 

Phaso huKan in rhc first wcok of August, 1071 u'ith the mailing of 
pnckgts of article, evaluation materials to the 100 scloctod 
I participants. Materials Hont. participant sub -groupinn. . and task. 

assigned Kcro idonticul to those of cho academicians phase (step S) 
I doscribedeurlLer. 

A flow of completed materials startod arriving at PMI in late 
August and continued through tho fall and into the winter. As in the 
I acadoinician phase, two separate no n - res pon don t follow-ups flettcrs) 

wore initiated by PMl at appropriate tines. Completed materials ^ 
j wore received from approximately 7S% of the community hospital 

practitioners . 

As in the early phases, respondents reportod that the extended 
time needed by many to completo the job was due to conflicting 
vacation or travel schedules and the si-o of the task. CMnny 
participants, both academicians and practi ..,,rs, reported spending 
more time at the task than the throe hours . , anally estimated.) 
In view of the size of the task and the rolat...ely small* honorarium 

ided, it was cxtremoly cncourafiing to note the high completion 
rates and supportive comments of many of the participants. 

All data obtained during implomcntation of the study, as 
doscribod above, wero tabulated, processed, and reported in the 
results section. 
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lhe_j.ncreased-numbor of participants receiving honoraria under the 
revised study design caused a decrease to ^SB'.OO in the size of Hic 
honoraria provided to academicians and cojiimunity hospital practitioner. 



l^artigipatj. ng IMiysicians 

f'inn issue from canli of ton iTiajor modlcal journals was 
soiectod for the study. All of tlic regular artJcXos from each 
issue were ratGd. The ton journals included two from oacli of 
five mydical spocialties: general practitioner?, internists, 
p G d i a t r i c i a n s J o b s t o t r i c i a n s - g n e c o 1 o g i s t s ^ and s u r ^i c n n .s . 

A total of IS editors and associate editors agreed to 
participate in tlie study by rating journal articles. Tho numhcr 
of participating editors froin each medical spCGialt)^ are pre- 
.^entod i n Tab In 1 , 

A total of 200 medLcal spGcialists wore invited to participate 
in tho study by rating journal articles in their specialty fields. 
The 200 physicians included 40 from each of the five specialty 
fiolds (see Table 2). Of the 200 invited physicians, 100 were 
academicians who were faculty members at medical schools; the 
other 100 were practitioners, Half of the academicians rnd 
half of the practitioners were asked to rate tlie journal articles 
using tho PMl criteria system. The remaining half of each group 
were askod to use their own criteria to rate the articles. 

Of th e 200 invi ted phy s i ci ans , 154 actua 1 1 y part i cipat ed 
in the study. The participants woro about evenly divided across 
tho category and specialty groups in the study (see Table 3), 

Articles from each of two issues were rated by the editors 
and physicians in each field. A total of 176 journal articles 
were rated by the editors (see Table 4} , A total of 192 
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TABLE 1 

Number of Pa rti c i oa t i nq Journal Editors 
in Each Specialty Field 



SDeci al ty Field 



Seneral Practiti oners 



I n tern 1 s ts 



Pediatricians 

Obstetricians-Gynecologists 
Surgeons 



Nunbe^ of Editors 



el 

2 

2 

= 1 



In eludes associate editor: 
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TABLE 4 

lumber of Articles Rated by Editors 
in Each Specialty Field 



Specialty Field 



Gansral Practitioners 

Intarnists 

Pediatricians 

Obstetricians-Gynecologists 
Surgeons 



Number of Articles 



12 
3 2 
51 
44 
37 



Total 



1 76 
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journal articles wcro rated by ^hc physicians (see Table 
Thfi n.nnhor of articles .rated by tho □ditors and physicia 
varied across the five specialty fiolds depending on the 
of articlos containQd in- the two journal Issiios rcprcsnn 
each specialty field. 
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TABLE 5 



Numbef of Articles Rated by Physicians 
In Each Specialty Field 



S p e c 1 a 1 ty Field 



General Practi t1 oners 

Internists 

Pediatricians 

Obstetricians-Gynecoloqists 
Surgeons 



Number of Article 



1 7 

38 

51 

44 

42 



Total 



192 



I^rocedure 

) Ail of the editors and half of the other physicians (academicians 

, and nract itioncrs) rated the journal articles in their spocialty 

field by using the clinical relevance criteria CARTICLIi EVALUATION 
FORM (CRLS 43), Appendix A), The remaining physicians rated the 
journal articles in their specialty field without using the clinical 
relevance criteria. They used rorm (ARTICLE EVALUATION FORM 
(CRLS 63), Appendix A) whereby each rater had to decide upon his 
own criteria. Thus two different types of criteria were used to 
assess articles , 

Two journals from each specialty field were rated by the 
physicians in that specialty field. Half of all th© physicians 
rated the articles from one of the journals and half rated the 
articles from the other journal. 

Regardless of which criteria a physician used, every physician 
made an overall assessment of articles using the same form. Every 
physician in the study rated a given journal for "must reading" by 
answering the following question: 

" Overall Assessment : The clinical value of 
this article warrants its recommendation for 
priority ("must") reading by the following 
target audi ence (s ) : " 

"Circle letters corresponding 
to recommended audience (s)" G I P 0 S GIPOS NONE 

CG=General Practitioners; 1= Internists- F^Pediatriciansi 

O^Obstetrician-Gynecologis ts J and S^Surgeons.) 

Bach category of specialist was scored a r if circled by a rater 
and was scored a 0 if not selected by a rater. 
ERIC "^'^^ score for each article was the proportion of physicians 

"who rated it as , "mus t reading" . Ths proportion scores for all the 



articles in a specialty field were averaged. The popularity of all 
the articles in, say. podiatrics was thus the avernge proportion 
of pediatricians who rated each artic-lo as "must rending". 

Threo such scores wore calculated to reproscnt the pop- 
ularity of all the articlfc-s in each specialty field (a) SpBcinlty 
Field Score - the averago proportion of physicians in tho articles' 
specialty field who rated each article as must rcBding for 
practitionors in that specialty field; (b) The Outside Fields Score 
the average proportion of times the physicians in the articles' 
specialty field rated each article as must reading for practitioners 
in each of tho four other specialty fields; and [c] the Six 
Categories Score - the average proportion of times the physicians 
in the articles' spGcialty field ratod each article as must reading 
for each of the five kinds of specialists and for primary physicians 
general ly (GI POS") . 



The present study investigates the effects of using the 
clinical relevance critoria system for rating tlio importance 
of mo.lical journal articlos, Raters either wore asked to use 
the clinical relevance critoria or were asked to develop and use 
their own critoria for evaluating articlos. The raters included 
editors, acadGmicians , and practitioners, and represented five 
medical specialty fields; general practitioners, internists, 
podiatricians , obstetricians - gynocologis ts , and surgeons, 

The study compares criteria and non-critoria ratei;s . Within 
each rating system, the study also compares: (a) editors, academicians 
and physicians- (h) raters in the five medical specialty fields; 
and (c) three criterion niQasures of an article's relevance. 
Correlational analyses were done to show degree of similarity among 
the above groups. Analyses of variance were done comparing the 
tendency of rators in these groups to designate an article as 
"must reading" for other medical specialists. 
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RliSULTS 



i 



Coiiipnrlson of Group s 

Comparison of Physi cians' Ratinfls of 
Articles in thoir gpecialt): l-iold 

Each article in a specialty field was rated for "must 
roading" by physicians in that spocialty field. The score used 
. Vtfas tho average proportion of physicians in the article's spocial 
ty field who rated each article as must reading for practitioners 
in their field, e.g., the average proportion of pediatricians 
rating each article in a podiatrics journal as being "must 
reading" for other pediatricians. 

A three-way analysis of variance was used to compare the 
differont groups of physicians. The groups compared were those 
who used tho clinical relovanco criteria vs. those who did not: 
academicians vs. practitioners; and physicians in each 
spocialty field vs. those in each other specialty field. The 
means are presented in Table 7 Ctoxt) and the statistical 
analyses in Table 1 CAppendlx B) . 

A significantly lower proportion of physicians (.444) who 
used the criteria rated tho average article as "must reading" 
than did the physicians (.533) who did not "use the criteria 
CF-6.2, p T.05). Significantly more practitioners (, 543) than 
academicians (.434) ratad the articles as "must reading" in 
their specialty field (Psg.s, p<,01). , ' 
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Fhysiciuns, regardless of the uso of criteria, in each o 
five specialties wore contrasted in thoir tendency to rate 
articles in each of their specialty fields as "must reading", 
There were no significant differences among those five groups 
However, there was a significant interaction between the 
variable of specialty and the variable of academicians vs. 
practitioners (F^2.D, p < ,05) , Ainong general practitioners, 
internists and pediatricians, practitioners rated more 
articles as ''must reading'' than did a cadcmi ci ans ; however, 
among gynecologists and surgeons, thgre was little difference 
between academi ci cans and nrac t i 1 1 oners * None of the other 
interactions wore significant, 

Com pgrisQn of Physicians' Rati ngs of Articles in Each 
of the Ho ur Fiel ds Qutside their Specialty Field 

liach articlg in a specialty fiold was rated by physicians 
in that specialty field for *'must reading*' for physicians in 
each of the other spgcialty fields, Tlie avorago rating of 
articles in a field was calculated. The score used was 
the average proportion of physicians who rated each article in 
thgir spcQialty field as "must reading" for practitioners in 
each of the four fiolds outside tho raters' specialty field, 
e.g. the proportion of pediatricians rating each article in 
pedlatrlcH as "muHt reading" for each of goneral practitioners 
in to mists, obstetriciuns-gynacologists, and surgeons. 

A thrgg-way analysis of variance was used to compare the 
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different groups of physicians* The groups conipared were 
those who used the clinical relovanco criteria vs * those wlio 
did not: academicians vs , practitioners; and physicians in 
each specialty field vs. those in each other specialty field. 
The means are presented in Tablo 8 Ctoxt), and the statistical 
analyses in Table 2 (Appendix B) * 

When specialists rated articles as must reading for . 
physicians outside that specialty, raters using the clinical 
relevance criteria were less apt to rate an article as must 
reading than non-users of the PMI criteria (a proportion of 
,114 as compared to ,130, £ ^ 7,9, £< .01). In addition, 
fewer academicians than practitioners rated an article as 
must reading for outside specialists C*113 as compared to ,140, 
£ a 7.2, £<.0l3* 

When physicians in each specialty field were compared to 
those in each other specialty field, the groups differed 
significantly in the tendency of specialists to rate an 
article as must reading for outside specialists* Tlie following 
groups differed considerably S2,4, £<.013r general 

practitioners (with a proportion of .312 rating an article as 
must reading for outsiders); internists (.138); pediatricians 
(.118), obstetricians-gynecologists (,086), and surgeons (.003), 
This indicates that the surgeons^ and obstetrlcions ' articles 
are spocializod and are generally viewed as unsuitable to 
other specialists, while the general practitioners' articles 
are viewed as more relevant to other specialists* 
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There was a significant interaction botween uso vs. not 
use of clinical relevance criteriaj and the five specialty 
groups p c ,05) , Pediatricians and surgeons who used 

the criteria rated more articles as ''must reading'' than did 
those who did not use the criteria. General practitioners , 
internists, and ob s t e t r i c i ans - gy ne co 1 0 g i s t s who used the 
criteria rated fewer articles as '"'must reading" than did 
those who did not use tlic criteria. These "must reading'' 
ratings, of courso, applied to physiciaTis in each of the 
outside fields. There also was a triple Interaction (FsS.l, 
p^iOS)* The other interactions were. not significant. 

Comparison of Physicians* Ratings of Articles 
across All Six Categories 

Bach article in a specialty field was rated for -'must 
reading'' by specialists in that field. The average rating 
of articles in a field was calculated. The score used was 
the average proportion of physicians who rated each article 
in their field as "must reading" for physicians in six 
categories-physicians In each of the five fields (G,1,P,0,S) 
and potential primary physicians (GIPOS), e,g. the average 
proportion of pediatricians rating each article in a 
pediatrics journal as being "must reading" for physicians 
in each of the five specialties, and for primary physicians 
general ly , 

A three-way analysis of variance was used to compare 



4 3 



the different groups of pliysicians. The groups compared were 
those who used the clinical relevanco criteria vs * those who 
did not: academiciaiis vs , practitioners; and physicians in 
each spQclalty field vs , those in each other specialty field. 
The means are presented in Table S (text) and the statistical 
analyses in Table 3 (Appendix B) . . 

A significantly higher average proportion of physicians 
(.238) who did not use the criteria rated each article as 
^■must reading'' than did the physicians (.177) who used the 
criteria^ (F=5.5j p<.05). Significantly more practitioners 
(.2-37) than academicians (.178) rated each article as "must 
reading" across all six categorios (pss.g^ p< ,0S), There 
was a significant difference (F^S.Sj p< iOl) among physicians 
in the five specialty fields in their rating of articles in 
their field as must reading across all six categories* The 
proportions for each group are: general practitioners (,352) ^ 
internists (.219), pediatricians (.201)j obstetricians- 
gynecologists (.191), and surgeons (,162)* There were no 
significant interactions. 

Comparison of Editors and Physicians 

A, series of two-way analyses of variance were done to 
compare editors with physicians on their tendency to rate 
articles as ''must reading J' The main purpose of these analyses 
is to compare editors with academicians and practitioners » 
as well as to compare the editors with physicians who used 
and who did not use the clinical relevance criteria. Thus 
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only the direct comparisons of the editors and physician groups 
will be presented in text. For other detailed analysos see the 
tables in Appendix B referred to helow. All the editors used 
the clinical relevance criteriaj while half of the physicians 
used it, and half, did not. 

The first variable compared was the average proportion 
of physicians who rated each article in their specialty field 
as being "must reading'* for physicians in that specialty field. 
(See Tables 6 and 7 in the text :^or means 0 The editors were 
compared to those physicians who used the criteria. There was 
a significant difference p<,0S3 among the average 

proportions of editors (,610), academicians £.4273 j and 
practitioners (,496), who rated each article as ''must reading'' 
in their specialty field. (See Table 4, Appendix B) • 

The editors were also compared to those physicians who 
did not use the clinical relevance criteria, There was a 
significant difference (F=7,0^ p<,013 among the proportions 
of editors (,610)^ academicians (,4653^ and practitioners (.608), 
( S e e T a b 1 e 5 ^ A p p e n d i X B , 3 

It appears from the above two analyses that editors value 
journal articles for specialty field readers niore than do 
physicians generally. The editors, all of whom used the criteriaj 
howovorj valued the articles about the same as did the 
practitioners who did not use the criteria* On the average^ 
the physicians not using the criteria valued the articles more 
highly tlian did tlie criteria users ^ and hence more closely 
resembled tho editors, 
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The second variable compared was the average proportion 
of physicians who rated each article in their specialty field 
as being ^'must reading" for physicians in each of the other 
four specialty fields, (See Tables 6 and 8 in the text for 
means 0 . ' 

The editors were compared to those physicians who used ^ 
the criteria, There was significant difference CF=3,7^ pc.OS) 
among the averago proportions of editors (,1143, academicians 
(,125)^ and practitioners (.160) who rated each article as 
"must reading'^ for physicians in oach of the other specialty 
fields. Thus practitioners were the most likely to recommend 
articles for other specialists. (See Table 6^ Appendix B.) 
The editors were also compared to those physicians who did not 
use the criteria. There was no significant difference CF=0,O, 
N.SO among the proportion of editors (,1153 ^ academicians 
(.115), and practitioners (,117). (See Table 7, Appendix Bj 

It appears from the above two analyses that editors value 
journal articles for readers outside the specialty field less 
than do those practitioners who used the criteria, and the 
same as do the other categories of physicians. On the average,, 
the editors were least different from those not using the 
criteria in comparison to its users In terms of the articles* 
relevance to outside specialists. 

The third variable compared was the average proportion of' 
physicians who rated each article in their specialty field 
as being *'must reading'' for all six categories each of the 
five specialties plus the combined category of all five 
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specialties, (See Tables 6 and 9 in the text for means,) 

The editors wore compared to those physicians who used the 
clinical relevance criteria, There was no significant dif- 
feroiice CF=1,7, N,SO among the proportions of editors (. 209), 
academicians (,189)^ and practitioners C*292) who rated the 
articles as "must reading" across all six categories, (See 
Table 8, Appendix B.) 

The editors were also comparod to those physicians who 
did not use the critoria. There was no s i gni f i cant ^ di £f erence 
(P~l,8, N.SO among the proportions of editors ('209]^ 
academicians (,171) and practitioners (.101), (See Table 9, 
Appendix B,) It appears from the above two analyses that 
there is little difference among editors and any of the 
physician gi'oups on the six categories rating. 
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CORRELATIONAL ANALYSES OP 'SMUST READING^' SCORES 

The three scores used in the correlational analyses are 
(a) specialty flGld the proportion of physicians who rated an 
article in their specialty field as "must reading" for others 
in their specialty field; (b) outside fields the proportion 
of physicians who rated an article in their specialty field as 
"must reading" for physicians in each of four other specialties ; 
and (g) six categories the proportion of physicians who 
rated an article in their specialty field as "must reading" 
in each of the above five fields plus an overall category of 
applying to physicians in all five specialty fields. 

Using the above three measures, academicians who used the 
PMI"^ criteria were compared with academicians who did not use 
it Csee Table 10). The correlations were .34 for the specialty 
field score^ ,51 for tlie outside field score, and .39 for the 
six categories score. Thus for acadeini c i ans there was a moderate 
amount of correspondence between users and non-users of the 
PMI criteria* 

For practitioners, as for academicians, the three scores of 
those who used the PMI criteria were compared with the three scores 
of those who did not (see Table 10). The correlations were |28 
for the specialty field score, .25 for the outside fields score, 
and ,03 for the six categories score. The latter correlation 
corresponds to no relation at all. For pr act it ioners ^ there was 
only a very limited correspondence between users and non-users 
of the PMI criteria, 

1. Note. Tlie term PMI (Postgraduate Medical Institutej criteria 
is another name for tlic clinical relevance criteria reforred 
to throughout this paper. 
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Table 10 

Correlations Between Physicians Using the PMl Criteria and 
Those not Using the PHI Critaria on the "Must Reading" 
Scores of Journal Articles 

Numbar of Specialty Outside Six categories 

Articles field score fielito score score 

Academicians 192 ,34^^ .51^^* ,39M 

Practitioners 192 ,28^^^ .25^^^ 01 



*^ £ .01 



so 



The correlation of .51 between PMl criteria and non-PMl criteria 
academicians on the outside field score was significantly higher than 
the .25 value for practitioners (| = 3,0, £ .01). Likewise, the 
correlation value of .39 between PMI and non-PMI academiclanB on the 
six categories score was significantly higher than the .03 value for 
PMl and non-PMl practitioners. Thus there was slgnif icantly more 
agreement among academicians than among practitioners on the outside 
fields score and on the six categories score, but there was no differ- 
ence in specialty field scores. 

Correlations were dona between groups using the PMl criteria. On 
each of the three scores, correlations were done between editors and 
academicians, editors and practitioners, and academicians and practi- 
tioners (see Table ll) . Correlations for the three pairs of physicians 
were low for the specialty field score and were moderate for the outside 
fields score and the six categories score. 

Correlations also, were done between groups not using the PMl 
questionnaire. On each of the three scores, correlations were done 
between editors and academicians, editors and practitioners, and 
academicians and practitioners. The correlations in Table 12 indicate 
only a moderate agreement for the three pairs on each score. 

To determine if there was more agreement among PMl questionnaire 
users than among non users, each correlation value in Table 11 was 
separately compared to the corresponding correlation value in Table 12. 
Only two of the nine comparisons were statiatieally significant. 
Academicians and practitioners using the PMl criteria showed significantly 
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Table 11 

Correlations among Physicians Wio U'sed the PMI Criteria 
on "Must Reading*' Scores of Journal Articles 



Editors x 
academicians 

Editors X 
practitioners 

Academicians k 
practitioners 



Number Specialty Outside Six categories 

of articles field score fields score score 



175 



175 



192 



,07 



.36** 



,48** 



** £ ,01 
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Table 12 

Correlations Among Physicians liJho Did Not Use the PMI 
Criteria on "Must Reading" Scores of Jouriial Articles 



Editors X 
academic lans 

Editors X 
practitioners 

Academicians x 
practitioners 



Number 



Spacialty Outside Six Categories 

of articles field score fields score score 



175 



175 



192 



,35** 



.44** 



.43** 



.41** 



.37** 



.30** 



.20** 



* £ .05 
** £ .01 
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higher agreement than did academicians and practitioners not using it - 

on the outGide fields scora (a correlation of ,60 xi* one of .41, 

£ ^ 2*7, 2 ,01) and on the six categories score (a correlation of ,48 

one of ,20, % ^ 3.2, £ ,01). Thus the PMl-criteria physicians 
were in significantly greater agreement than the non=PMl=criteria 
physicians in two out of nine comparisons, and not significantly 
different in the other seven comparisons. 

Correlations were done to determine to what extent articles which 
rated high in their specialty field also rated high in other fields, 
and on the six categories. The three measures used for each article 
were the specialty field score, the out ids fields score, and the six 
categories score. For each group of physicians, correlations were 
obtained for each of three pairs of scores^ the specialty field score 

the outside fields score; the specialty field score vs* the six 
categories scorei and the outside fields score vs. the six categories 
score. These three pairs of scores were correlated for physicians 
using the PMl criteria (see Table 13), and for physicians not using 
the PMl system (see Table 14). Separate correlations were obtained 
for editors, academicians^ and practitioners in each table. 

Across all physicians in both tables there was a rather low but 
consistent correlation between specialty field score and the outside 
fields score. There was a moderately high correlation between the 
specialty field score and the six categories score* There was a high 
correlation between the outside fields score and the six categories 
score. 



Table 13 

Correlations Among ''Must Reading*' Scores of Journal Articles 
Rated by Physicians Using the PHI Criteria 



Numbgr Specialty field 

of articles x four outside 
fields 



Editors 175 
Academicians 192 
Practitioners 192 



Specialty field 
K the six cate-- 
gorieg 



.61^^ 
.28** 



Four outside fields 
X the six categories 



.01 



Table 14 

Correlations Among "Must Reading" Scores of Journal Articles 
Rated by Physicians Not Using the PMI Criteria 



Number 
of articles 



Specialty field Specialty field 
X four outisde X the six cate- 
fields gories 



Four outside fields 
X the six categories 



Editors 175 
Academicians 192 
Practitioners 192 



.61^^^ 
06 



.79** 
,25** 



.01 



of being selected as "must reading" in other fialda. The quality of 
an article rated high in a specialty field appeared less pertinent than 
its relevance to other fields when physicians rated it for "must reading 
in other fields. The all six categories score appeared more closely 
related to the outside fields score than to the specialty fields score* 
Thus an article's breadth of relevance appeared to be more related to 
its all six categories rating than did its quality rating in its 
specialty field. 

Also in Tables 13 and 14 the correlations among the scores vjere 
generally lower for practitioners than for editors and academicians. 
The correlations for practitioners using the PHI criteria were generally 
much higher than for practitioners not using the PMl criteria. Thus 
there was less consistency across the three sets of ratings for 
practitioners not using the PMl criteria than for any of the five 
other groups of physicians. The editors and academicians were each 
reasonably consistent across the three sets of ratings regardless of 
whether they used the PMl criteria. 
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Rogression Analysis of PMI Criteria^ 

This section of the results involves an intornal analysis 

of the PMI criteria. Unlike the above results comparing 

groups of raters on the basis of proportion scores, this 

section looks at ratings by individual physicians on each 

article. Each correlcation or other value in this section 

represGnts a large group of individual raters. 

Each physician ratod eacli article on the eight 

criteria and on the ovoraU criterion of must reading. lie 

did this for his own field, for each of four other fields 

and for primary physicians generally, CGIPOS], 

The PiMI criteria used are shown in Appendix A, It is 

important fortho reader to turn to them now, in order to 

understand this section of results. 

I:ach physician rated each article on each of the eight 

PMI criteria and for must reading. The ratings on each 

critGrion were made for readers of each article in each of 

the five specialty fields and for primary physicians 

generally representing the five specialties considered as a 

group in their common role as primary physicians. 

Three scores were obtained for each criterion; (a) the 

specialty field rating for readers in the rater^s specialty 

field; (b) the five fields rating the sum of the ratings 

across the five specialty fields; and (c) the rating for 

a. Note. The term PMI CPoa tjraduate Medical Institute) 
criteria is another name for tho clinical relevance' 
criteria referred to throughout this paper. 



primary physicians generally. <Thc rating for primary 
physicians is a general rating that tJie physician makes 
once . j 

Fur Guch score, a stepwise regression was done using 
the eight PMI criteria (Appendix A) as potential predictors 
and the must reading score as the criterion. The stepwise 
rfBgrossion formula was used to select t]\e best three 
predictors Cout of the ciglit PMI critGria) to prodict the 
must reading score. The formula gives the value of the 
Stepwise R, which is the correlation value indicating how 
well the must reading score ean be predicted from the 
three predictors. 

The formula also gives the Beta woight indicating the 
predictive value of each of the three predictors. The Beta 
weight is the amount that each predictor score would ^ e 
weighted to give the stepwise R. That is, if you weigii 
each of the three predictor scores by their respective 
Beta weight, the total of the weighted scores will max- 
imally predict the must reading score, Tlie larger a pre- 
dictor's Beta weight, the more it contributes to predicting 
the **must reading'' score. Inspection of a larger series of 
Stepwise regrossion formulas indicates that the Stepwise R 
would not be appreuiably increasod by the use of more than 
three predictors. Each table presented will contain the 
three best predictors. 

The analyses in this section pertain to the editors 
and to those academicians and practitioners who used the PMI 
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criteria. The analyses were done to determine which PMI 
criteria could best predict the must reading scores. 

The Stepwise R was used to predict the specialty field 
score the must reading score for each article 1n the rater' 
own specialty field. The predictors were the specialty field 
ratings on each of the eight PMI criteria. The purpose was 
to determine how well (Stepwise R value) the specialty field 
score could be predicted, to locate the three PMI criteria 
which were the best predictors, and to give the Beta weights 
for each of those predictors. Four Stepwise R's were obtained 
one for Editors, one for Academicians , one for Practitioners, 
and one for all three categories of physicians combined. 

The Stepwise R analyses for specialty field score are 
presented in Table 15. For each group of physicians and for 
the combined group, thj best predictor 1s PMI criterion 4, 
the second best predictor is always PMI criterion 1. The 
third best predictor varies somewhat from group to group, 
for the combined group it is PMI criterion 2, For' the com- 
bined group the Stepwise R 1s .616 indicating a moderately 
high prediction of the must reading score using PMI criteria 4, 
I and 2 as the predictors. For the combined physicianSi the 
Beta weights for the predictors are: PMI criterion 4 (Beta - 
.401), PMI criterion 1 (Beta ^ .222), and PMI criterion 2 
(Beta - .072). Thus, the must reading score 1n the specialty 
field can be moderately well predicted from criterion 4 and 
1 with, only a little added prediction gained from criterion 2, 
Adding other predictors would be of little value. 
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. The Stepwise R was used to pi-edict the five specialty 
fields score the sumof the ratings for must reading for 
th-e five speclaUy fields. Thi predictors were the sum of the 
ratings for the five fields on each of the eight PMI criteria. 
Four Stepwise R's were obtained one for Editors, one for 
Academicians, one for Practitioners, and one for all three 
categories of physicians combined. 

The Stepwise R analyses for the five specialty fields 
score are presented in Table 1 . For each group of physicians 
and for the combined group, the best predictor is PMI criterion 
4. For three out of fourgroups including the combined group, 
the second best predictor Is PMI criterion 1. For the com- 
bined group, the third best predictor is PMI criterion 8. 
For the combined group the Stepwise R is .637, indicating a 
moderately high prediction of the must reading score using 
PMI criteria 4, 1, and 8 as the predictors. For the combined 
group of physicians, the Beta weights for the predictors are: 
criterion 4 (Beta = .377), criterion 1 (Beta . .239), and 
cri.terion 8 (Beta = .150). Adding other predictors would be 
of little value. 

The Stepwise R was used to predict the primarv physicians 
rating of must reading for physicians across the five specialty 
fields generally. The predictors were the eight PMI criteria 
ratings on the same variable. The Stepwise R analyses for the 
primary physicians rating are presented in Table 17. PMI 
criterion 4 1s generally the best predictor, and PMI criterion 
1 is generally the second best predi ctor , ■ and PMI criterion 8 
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is generally the third best predictor. 

For the combined group of physicians, criteria 4, 1, and 
8 are the best predictors in that order. For the combined 
group the Stepwise R 1s .520 Indicating a moderate prediction 
of the must reading score using PMI criteria 4, 1 , and 8 as 
the predictors. For the combined physicians, the Beta weights 
for the predictors arei criterion 4 (Beta = .257), criterion 1 
(Beta = .250), and criterion 8 (Beta = .116). Adding other 
predictors would be of little value. 

The Stepwise R was used to predict the primary physicifms 
rating of must reading for physicians across the five specialty 
fields generally. The predictors were, in this analysis, a 
different set of scores. The predictors are based on the five 
specialty fields score -- the sum of each PMI criterion rating 
for the five specialty fields. In sum, the PMI criteria, each 
based on the sum of five specialty fields scores, are used to 
predict the primary physicians rat.,.e. The analyses are done 
for each of Editors, Academicians, Practi ti oners, and all three 
groups combined. 

The Stepwise R analyses to predict the primary physicians 
rating from PMI criteria based on the sum of the five specialty 
field ratings are presented in Table 18. There is somewhat 
more variation in the predictors for each group, so only the 
predictors for the combined group of physicians will be de- 
scribed in the text. The best predictor is criterion 4 
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(Beta ^ .215), the second host predictor is criterion 1 
(Beta = .204), and the third best predictor is criterion S 
(Beta = .141). The Stepwiss R is .454 indicating only a 
moderate prediction using criteria 4, 1 and 8. ■ 

To detsrmine the best way to predict the general must 
reading rating for primary physicians, the combined groups' 
Stepwise R's £ram Tables 17 and 18 were compared. The must 
reading score for primary physicians is better predicted from 
PMI criteria based on the primary physician rating CStepwise R 
.520), than from PMI criteria basod on the sum of the ratings 
across all five specialty fields CStepwise R = ,454). This 
•difference is significant (T « 2.78, p.: .01). This finding 
means that the must reading ratings for primary physicians 
generally are more closely related to criterion ratings for 
primary physicians generally than to the summed criterion 
ratings made for each of the five types of specialists. 

The Stepwise R indicates how well the must reading score 
can be predicted from ratings on the clinical relevance 
criteria. In order to determine which sots of scores had 
the highest relationship between criteria and must reading 
score, the four Stepwise Rs were compared in value. 

For all groups combined, the Stepwise R values for the 
predictions of must reading scores are compared for each set 
of scores. The Stepwise R of .637 based on the ■specialty 
fields ratings was significantly higher than the, Stepwise R 
of .520 based on the primary physicians ratings (z = S.OO, 
p< .01), and was significantly higher than the Stepwise R of 
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.454 for the primary physicians scoro prodictcd from criteria 
based on the sum o£ the five specialty field? ratings (z - 
7.78, p<.013. Likewise, the Stepwise R of .637 for the p 
predictions based on the sum of tliG ratings of tlic five 
specialty fields was significantly higher than the Stepwise K 
of .520 based on the primary physicians ratings (i ^ 4.17, 
p< .01), and was significantly higher than the Stepwise R of 
,454 for the primary physicians score for the predictions 
based on the sum of the five specialty fields ratings (2 - 6.94 
P < ^01) , 

Within each of Tables IS = 18, there did not appear to be 
major differences between the values of the Stepwise R's 
obtained for each of Editors, Academicians, Practitioners, 
and for the three groups combined. 

Across the four tables, for the combined groups, the 
best predictor was always criterion 4, and the second best 
predictor was always criterion 1. The third best predictor 
was criterion 8 for Tables 16 - IS, and was criterion 2 for 
Table IS. 

Based on these findings it would be quite reasonable to 
reduce the eight PMI criteria to three criteria (criteria 4, 
1, and 8 in that order). Possibly criterion 2 could be used 
as the third best predictor for ratings within the specialty 
field, but the author dom^s not really recommend this as 
criterion 2 adds little to the Stepwise R for the specialty 
field score. 



The Stapwise Rs presented in this section have thus 
indicated the best three independent criterioii predictors of 
the must raading scores. The Stepwise R formuU tends to 
pick predictors which are independent (uncorrel ated) with one 
another. In this study, these three predictors, were not 
the three having the highest individual correlation with 
the must reading score. 

The mean ratings of the articles on each criterion are 
presented in Table 10, Appendix B, The independent correlation 
of each criterion with its respective must reading score is 
preicntod in Table 11, Appondix Some criteria (e.g., 

eriterlon 3) preaicted the must reading score rather well, 
but did not shov/ up among the best three predictors in 
multiple regression because they were redundant (highly 
correlated with a better prodictor). For example, criterion 
3 was highly correlated witli criterion 4, so only criterion 
A was selected by the multiple regression equation to 
roprasont the area of '*s i gn 1 f ic an co of article ^^ informati n 
to practico'' in prodicting tho must reading score. 
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Appraisal of the Clinical Relevance Criteria System 

All physicians who evaluated articles using the clinical 
relevance criteria, then completed a form to evaluate those 
criteria. See Appraisal of Article Evaluation System (Form 
CRLS23, In Appendix A. Raters indicated their reactions to 
it by answering questions A through H, below. 
"A. What, if any, additional criteria would you add to the 
present system?" 

Suggested additions Included categorizing of articles by " 
audience, type of article, or use of article; specialized 
evaluation; additions to the overall evaluation; and evaluation 
of clarity of presentation. 

Categorizing of articles by audience, type of articles, or 
use of information was suggested 1n 29 responses, including the 
following: (a) indicate audience by a general interest category 
(1 response), by specialty field (3 responses), by smalTer 
categories such as thoracic surgeon and hematologist (5), 
or by role -- academicians, practitioners, researchers (11); 
(b) indicate type of article review, new knowle'qe, refine- 
ment of existing knowledge, or comprehensive (8); and (c) in- 
dicate use of information for diagnosis, treatment, or 
professional operations (1), 
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Specialized evaluation was suggested 1n 6 responses- 
(a) use a different grading system for philosophic or risearch 
papers, since both may be worthwhile without being immediately 
practical (2 responses); (b) indicate appropriateness of 
subject matter to Journal 1n which 1t appears (3); and 
(c) use some criteria indicating value to subspeciaUies (1). 

Additions to the evaluation were suggested In 14 
responses: (a) add a zero rating but cut down on number of 
choices in the scale perhaps use "must," "should," and 
"not important" (5 responses); (b) add a rating such as 
"worth reading to be well informed, even though not practical" 
(7); and (c) add a rating of "Important - limited use," since 
an article could be valuable and still concern a relatively 
rare disease (2). 

Evaluation of clarity of presentation was suggested in 15 
responses: (a) assess writing styl e,- including summarizing, 
omission of unnecessary detail, comprehensibn 1 ty and use 
of subtitles (11 responses); (b) assess the use of tables 
and illustrations for appropriateness and quality (3); and 
(c) for controversial articles, note whether alternate views 
are expressed (1). 

"B. Which, if any, of the criteria would you omit from the 
present system?" 

Criteria recommended for omission are shown in Table 19. 
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Criteria 1, 6, and 7 apparently were considered either 
most Important or least redundant with other criteria. 
Criterion 8 seemed to be valued least. 

Some raters suggested combining the following criteria: 
3 and 4 (suggested by 10 raters); 1 and 3 or 4 or both 
(suggested by 4 raters); Zand 5 (4 raters)- 2 and 8 (4 rate 
5 and 7 (3 rattrs); 1, 2, or 6 and 7; 5, 6, or 7 and 8. 

Regarding writing style, some raters stated that 
elegance was Irrelevant; othersnoted that clarity was 
important. 

"C. Should one or more of the listed criteria be weighted 
more heavi ly than others; i.e.. carry more Importance? If 
yes, please elabor ate (including your recommendations for 
relative weight or importance)." 

Tables 20 and 21 show the pattern of affirmative and 
negative responses to Question C and the criteria recommended 
for rglatlvely heavy weighting. 

Most raters considered weighting of the criteria to be 
desirable. Suggested for the heaviest weights were 
criteria 3 and 4; for the least heavy were criteria 5 and 8. 
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Table 20 

I Affirmative and Negative Responses to the Question of 

Weighting Some Criteria In the Clinical Relevance Syste 

(Question C) 

Response 



Affirmative Negative No response 



Edi tors 


12 


2 


3 


Academi c1 ans 


26 


9 


4 


Practitioners 


21 


8 


5 


All raters 


59- 


19 


12 
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Table 21 

Suggested Relative Weights of Criteria, Showin 
Rank for each Criterion 
(Question C) 



g Mea n 



Raters 



N 



Criterion 



4 5 



7 8 



Editors 8 
Academf clans 25 
Practitioners 17 
All raters 50 



3.25 6.38 3.44 3.62 6.00 3.44 4.25 5.62 
4.40 5.06 3.52 2.94 5.32 5.38 3*88 5 . SO 
3.50 4.88 3.47 3.12 5.56 5.21 4.79 5.47 
3.91 5.21 3.49 3.1 1 5.51 '^.01 4.25 5.51 



'ote.^-^A rank of 1 indicates the heaviest weightinc 
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"D. Do you think that this journal article evaluation 
system has intrinsjc merit?" 

Table 22 shows the pattern of affirmative and negative 
responses to Question D. More than five times as many raters 
answered affirmatively as answered negatively the questions 
regarding the intrinsic merit of the clinical relevance 
criteria system, 

Favorable comments labeled the clinical relevance 
criteria systems unique, time-saving, and quite complete, A 
practitioner stated that, in general, practitioners read out 
of interest in a particular case they are treating, and that 
they are being deluged with non-essentia i material, Evalu- 
ators thought the criteria system could help in several ways. 
Editorial boards could combine the results with other informa- 
tion to (a) select articles for publicationi (b) do compara* 
tive evaluations of their journals relative to others^ and 
(c) make Journals more tailored to specific audiences. 
Medical libraries could accumulate specialized bibliographies* 
Physicians could use overal 1 assessment ratings to locate the 
readings most useful to them. 

Some ivaluators thought the PMI criteria system had 
intrinsic merit but was limited in that it (a) focused on 
usefulness of information in clinical practice rather than 
intrinsic worth of the article or other criteriai and (b) did 
not meet the needs of general practitioners for a broad range 
of information I perhaps in digest form. Others noted that 
the system-s merit depended on the skill of the reviewers 
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Table 22 

Affirmative and Negative Responses to the Question Regarding 
the Intrinsic Merit of the Clinical Relevance Criteria System 

(Question D) 



Response 



Raters Affirmative Negative No response 



Editors 8 3 3 

Academic'ans 30 6 1 

Practitioners 30 3 i 

All raters 68 12 5 



and feu that the system was acceptable 1f done on a group 
rather than an Individual basis. Others stated that the 
cnteria system was too subjective, too complex, or too 

difficult. 

_ A^ong those evaluators who thought the cll„ica, relevance 
crUarla system did not have Intrinsic «r1t. so« stated 
that n.was not as usefu, to the reader as (a) reading titles 
and abstracts, then Choosing articles; (b) ski™™i„g the few 
«st pertinent Journals; or (c) having a guide stating ■ 
Whether an article was a .ust for everyone, a ™ust for any- 
one, or neither. Others noted .that for the rater, it was 
hard to know what physicians in other specialties would 
think Of an article and It was hard to deal wlthaco.pll- 
"ted evaluation system; 1n addition, one's knowledge of a 
subject ^ight influence his evaluation. Others felt simply 
that the evaluation syste. would be no substantial improve- 
ment over editors' or abstractors' present »,eans of evaluation, 
and, would only increase the information lag which already 1s 
a problem in publishing. 



journa" 



Table 23 shows the patterns of a,ff1rmat1ve and negative 
responses to Question E. More than four times as many raters 
favored as disfavored the differential evaluation of Journal 

articles. 




^ ERIC 
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Table 23 
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Acadami c1 ans 
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Practi tloners 


22 


7 




3 


All raters 


63 


15 




7 



78 



Raters felt that differential evaluation would be useful 
to editors, abstractors, and readers. Such evaluation would 
be particularly useful to the readir seltcting from general 
.Journals or selecting relevant articles from Journals outside 
his specialty, but less useful to anyone reading Journals 1n 
his own specialty. 

Raters suggested that differential evaluation could be 
done especially well In relation to one's own specialty but 
that it was hard to know the interests of physicians outside 
one's own specialty, especially since specialties do overlap. 
Some raters suggested categorizing by audience (e.g., re- 
searchers and practitioners). Others found the primary 
physicians category difficult to use and redundant, wi th the 
outside fields categories. 

"F. Would you prefer a different system of criteria?" 

Table 24 shows the pattern of affirmative and negative 
responses to Question F. Most evaluators stated that they 
would not prefer some alternative system of cri teri a , even 
though they might change some features of the system. 

Those who favored a different systim suggested the follow 
ing: use of words rather than numbers; addition of criteria 
(described in responses to Question A, above); combination 
of criteria already used (see responses to Question B); 



79 





Table 24 




Affirmative and 


Negative Responses to the Question 


Regardi ng 


Preferences for 


a Different System of Criteria than 


the 


Clfnlcal RiUvance System 






(Question F) 






Response 


— - - — — — 


Raters 


Affirmativa Neqative 


No response 


Ed1 tors 


6 6 


5 


Acadenil c1 ans 


9 24 


5 


Practitioners 


5 21 


7 


A11 raters 


20 51 


17 
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addition of specialties to be covered; use of a less sub- 
jective method of evaluation; evaluation of specialty journals 
only and only In relation to their target population; and 
decision regarding a suitable audience, to be followed by 
evaluation of clarity only 1n relation to thtiJ: audience. 

"G. Would you prefer a totally different approach to article 
eva 1 uatlon?" 

Table 25 shows the pattern of affirmative and negative 
responses to question G. Most evaluators stated that they 

would not prefer a totally different approach to article 
evaluation, but again, some suggested modifications (de- 
scribed above). Some who favored a different approach 
suggested a shorter and simpler one. Several respondents 
stated that they were unsure what the aUirnative approaches 
might be. 
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Table 25 

Aff1rmat1vi and Negative Responses to the Question Regardinc 
Preference for a Totany Different Approach to Article 
Evaluation than the Clinical Relevance Criteria Approach 

(Question G) 



Response 



Raters 

Edt tors 

Ac ademi clans 

Practitioners 

All raters 



Af f 1 rmati ve 

2 
4 

, 6 
12 



Negati ve 

8 
29 
19 

56 



No response 

5 
6 
8 

19 
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Evaluation Criteria Originatod by Raters Not Using the 
Clinical Rolovanco Critsria 

Raters who were not askod to use the clinical relevance 
criteria were asked instead to use their own criteria and to 
^, listthosecriteria. 

The' independcntly-originatod evaluation criteria 
could be grouped into five major catogories- importance 
(listed by raters 1S72 times], research design Clisted 472 
times), presentation (listed 423 times), topic (listed 363 
times), and information (listed 2S0 times). 

The overall category of importance to practice, with 
1872 responses,' included importance to practice (listed by 
raters S47 times), rolevanco to many cases or doctors (listed 
__48^ times), general relevance important vs. trivial (367 
times), value of article limited (2381, relovance to important 
A casos (123), relevance to only one type of physician (59), and 
I . relevance to' recent patieTit (SI). 

Research design, listed by raters 472 times, included 
validity of study -- excellence of data (listed 188 times), 
extent of. data completeness of study (140), conclusions 
drawn (88), scientific design (26), size of study population 
(18), and analysis -- or study methods used (12). 

Presentation,^ with 4 23 respons e s , included clearity 
(134 listings), length or conciseness (88), good or poor 
writing (36), writing style or organization (76), and 
ERXC" illustrations (39). 



Tlio catogory of topic^ with 363 responses, included 
originality of inforniation (listed 212 times), quality or 
validity of topic (150 t i me s), interest (127 times), typo 
of subjucts (371, and teclinical advance (IS). 

In formati on, listed by raters 280 times, included 
provision of good brickg round information educational value 
(164 listings), b ib 1 i ograpliy ioQ) , and adequacy of bnckgrDund 
in format ion for each audi enco (3 0) . 

In comparison to the clinical relevance criteria system^ 
the sct^of criteria originating with non-systom raterH was 
strikini^ly different in one respect: there wns no differential 
evaluation by type of audience except in regard to adequacy 
of background information. Altjiougli some journals and some 
articlos have only one audience of an/ size, many others can 
profitably be evaluated for practitioners in more than one 
sp'cialty; such differentiation was not made by the n.j n-systeiii 
raters, with tliu one exception noted above. 

in addition, the clinical relevance critoria included 
topical intere:4t or timeliness (Criterion 1), not mentioned 
as such by non-system rators^ who did^ however, list interest 
a s a c r i t e r i o n . 

Non-system raters did list all of tlio other criteria 
whicli comprised the clinical relevance criteria system^ although 
individual non-syHteni raters did not necessarily use the entire 
net :ind ::;any raters used or ' y a very f ew » 

Some non-system raters originated criteria which were ^not 
used in the /clinical relevance criteria system. Those criteria 
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includ'ed: rolGvancc to only one typo of physician (i.c,, raters 
valued breadth ^ since they were not evaluating for individual 
specialty audiences), r e J o \^ a n c o to recent p a t i e n t j type of 
subjects^ size of study population, extent of data completeness 
of study, scientific design, anal ys is or study methods used, 
conclusions drawn (tlio latter six criteria indicating academic 
intcrc:its as opposed to the practi^ ^1 focus of the clinical 
relevance criteria), lengtli, illustrations, bibliography, and 
provision of good background information educational value. 
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EDUCATIONAL APPLICATIONS OF CLINICALLY RLLliVANT ARTICLHS 

In addition to developing and evaluating a sut of 
Clinical Re levance Criteria, the contract specified that PMI 
would "explore educational and patient care uses to whicli a 
core collGCtion of current journal articlos relevant to 
practice could be put and to provide examples of such uses as 
SGOinmostfeasible''* 

Deliberations during the courso of the contract among 
PMI staff jnembcrs and consultants yielded concensus that one 
of the most promising potential educational applications of 
a core collection of curront jourjial articles judged to be 
relevant to clinical practice would be in the dcvelopnent of 
physician s e 1 f - as s ess men t exams based on the inforniation 
contained in articles so identified, 

PMI has extensive experience in designing physician self- 
assGSsmont exam.s as a result of several years of work in 
developing the Core Content Review^ a series of review exams 
covering all aspects of family practice, foi the Connecticut 
and Oliio Academies of Gcnoral Practice. These exanis consist 
of both multiple choice and true=faise questions which are 
printed in a booklet which is mailed to participating physicians 
for self ^administration in their offices or homes at thoDr 
convenience. After a specified poriod of time participating 
:^hysicians receive a second booklet containing correct 
answers and annotations to the questions as well as references.. 
In addition to supplying a direct educational experience, use 
of this format permits the individual physician to assess 
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objectively his educational needs and provides inf oi^mat ion to 
guide his further continuing education efforts. 

Tost Qu stions for tliose exams wore developed by prominent 
Bos ton - are a niedi c a 1 s cli oo 1 t e ach e rs and researches were then 
screened by PMI . Que s t i on u^r i t o rs were free to use as n data 
base for their questions what ever informatiDn they tliought 
family practitioners should be conversant with* Under the 
current contract this concept was liiodified by asking similar 
question writers to create questions busod on tlio content or 
Information contained in a sample of tliose journal article 5 
most frequently soloctod in the study as being clinically 
relevant (based on frequency of ro commondat i on as priority 
*'musf needing), i.e., an attempt was made to develop a sample 
set of questions appropriate to a pliysician s e 1 f - a s s es smo n t 
exam like the one described above using as a data base a 
sainple of a "core collection of current journal article? 
relevant to practice". 

The five most highly rated (as dofined abovql articles 
of each of the ten journals (the contents of only a single 
issue of each was examined in the study) in the study were 
selected (see appendix C for a list o£ the articles selected)-. 
One of tan question writers (as defined above) was assigned 
to each group of five articles and was asked to write 3-^4 
questions per article. Reprints of the appropriate articles 
were supplied to the question writers. In addition to 
compiling questions, answers^ annotations and referenceSj 



question writers wore askod to gear sonio of their questions 

to the current knowladgo needs of specialists and other questions 

to the needs of generalists, QuGStion writers wore asked to 

appropriately identify the category into which each question 

fell. i,e* genera list applicable, specialist applicable or 

both generalist and specialist applicable, A portion of 

the specific instructions to question writers was as follows: 

. . , ,WG arc trying to develop sample self- 
assess me II t exams or teaching exercises based 
on the literature Identified as most clinically 
relevant by our criteria systeTri. That is, - o 
would like to construct a series of multiple 
clioicc questions wlii^Ji reflect the essential 
information contained in a sample of the 
articles which ratod highest on our criteria 
of clinical relevance* linclosed are five 
of the more liighly rated articles from an issue 
'f one of the journals in the study. We would 
.ike you to write a series of approximately 
three to four (3 - 4) multiple choice questions 
for each of the articles (or 15 - 20 questions 
in alio The correct answer to each question 
should be indicatodj and a brief comment or 
annotati^^n explaining why, the answer is correct 
should be included for each question* 

In addition please list several pertinent ref- 
erences for each of tlic questions. (Tlie 
• ■ ^irticle itself, of coursQ, sh.ould be included 
among the references and o thcrft may be t aFen 
from its own bibliography). The questions 
should be goared to testing knowledge or under- 
standing of the essential information or points 
contained in each article. It is quite possible 
that not all articles or all material within 
a given article will be equally applicable to 
the information noeds of both specialists and 
generalis ts . Therefore , p lease des ign some 
questions gemred to tlie current knowledge nee.ds 
of specialists and other questions appropriate 
for gen3ralists , Individual questions should 
be labelled to indicatJ whether they are 
"specialist applicable'*, '^generalist applicable''^ 
or "both specialist and generalist applicable. " 

o 
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For your reference, I am enclosing samples 
of similar questions that wore developed 
for use in the Core Control cview, a sGlf- 
assessment exam for family practitioners. 
Whi le these questions were specifically 
developed to cover only family practice and 
were not generated from specific articles, 
they sliould provide an indication of the 
question, answer, etc* form which we would 
like you to follow. I am also enclosi ng 
special forms on which wc would like you to 
type your questions, answers, annotations 
and references . Simply fill out a form 
for each article (listing title, etcO and 
type your questions, etc. below....'' 

The ten question writers generated a total of over 

150 sample question items. The questions, answers, annotations 

and references appear in appendix D unedited and as submitted 

to PMI on standardiEed forms. As is evident from the comments 

of quistion writers and from inspection of the material 

produced, it would be quite feasible to generate appropriate 

test items from a core collection of current journal articles 

which have been identified as relevant to clinical practice. 

Furthermore, question writers seemed to be able to design 

both specialist and psn.ralist oriented questions based on 

the content of a given article. Tlius within this technique 

there would seem to exist a potential for using a common 

data base to create a variety of generalist and specialist 

oriented self-assessment review exams. 
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SUMMARY or RHSULTS 

Group Comparisons 

The editors, academicians, and prncti tioners from five fields 
were compared on thoir tendency to rate articles in their specialty 
field as must reading for a) specialists in that field b) spocial- 
ists in outside fields and c) a total of ratings across tlic five 
specialty fields plus a general rating for primary pliysicians. 
The editors used the clinical relevance criteria, IJalf of the 
academicians and practitioners used the clinical rr'evanco criteria 
half did not us© it. 

The articles were, rated as must reading fgr practitioners in 
the article's specialty field 61% of the time by the editors, 431 
of the time by the academi ci ans ^ and 54% of the time by the 
practitioners. The articles were rated as must reading for 
practitioners in eacli of four outside fields 11^^ of the time by 
the editors, ll'e of the time, by the academicians , and 14% of the 
time by the practitioners. The articles were rated as must reading 
in the combined six categories Cfive specialty fields plus primary 
physicians generally) 21% of the time by tlie editors, 18% of the 
time by the academicians, and 24% of the time by the practitioners . 
In sum, the editors rated the articl ' highest in their specialty 
field and the practitioners rated them highest outside their 
specialty field. 

The academicians and practitioners who used the clinical rel- 
evance criterid were compared to those who did not use it, Articles 
were rated as must rrading in the article^s specialty field 44% of 
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the time by the criteria users and 53". of the time by the 
non-users. Articles were rated as must readini for practitioners 

in each of four outside fields 111 of the time by criteria users 
and 14% of the time by non-criteria users. ArticlGS wero rated 
as must reading across ,oacIi of the six categorios 18% of the 
time by criteria users and 241, of the timo by non-users. In sura, 
users were less likely to give the- articles a positive rating 
than were non-users. 

There was very little difference between academicians using 
and academicians not using the critgria system on each of the 
three scores. However, the practitioners who used the criteria 
rated consistently fewer articles as must reading across .the three 
scores than did the practitioners who did not use the criteria, 
Virtually all of the difference between physicians using and not 
using the criteria was due to. the differences for the practitioners. 

The physicians (academici ans and practitioners) in each of the 
five specialty fields rore compared. The ratings of arr cles as 
must reading in the articles specialty field ranged from 41% for 
obstetricians-gynecolQgists to 561 for pediatricians. -The ratings 
as must reading for each of the four outside fields ranged from 
9% by obstetricians-gynecologists to 31% by general practitioners. 
The ratings as must reading for primary physicians generally ranged 
from 161 by surgeons to 3S% by general practit Uners . The articles 
in general practitioner journals are relevant for other specialists 
more often than the articles from journais in the other four 
specialties .■ ■ . 
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Correl ational Analyses of ''Must Rcadini, ' Scores 

Correspondence between usors and non-users of the clinical 
relevance criteria was studied using three scores, The tliree 
scores used were the proportion of pliysicians who rated articles 
in their specialty field as must reading for pliysicians a) in 
their specialty field, b) in each c- four outside specialty 
fields and c) in general as primary physicians. 

For academicians, there was a moderate amount of corresponden 
between users and non-users of the clinical relevance criteria 
system. For practitioners, there was only a very limited 
correspondence between users and non-users of the criteria system 

Corrolations were done among editors, academicians and 
practitioners, all of whom used the clinical relevance criteria 
system. Correlations for the three pairs of physicians were low 
for the specialty field score and wore moderatQ for the outside 
fields score and the primary physicians score. Academicians and 
practitioners who did not use the critorla system showed only a 
moderatfc. agreement with each other and with the editors on each 
score. 

Academicians and practitioners who used the criteria were in 
somewhat higher agreement with one another on two scores (the 
outside fields- score and the primary physicians score] than were 
academicians and practitioners who did not use the criteria. 



Regression Analysis of PMI Critorla 

Each physician rated each article on tho eight clinical 
relevance criteria and on the DveraU criterion of nmst reading. 
He did this for his own field, for each of four outside fields 
and for primary physicians generally. for each score, a stepwise 
regression was done using the eight PMI criteria as potential 
predictors and the must reading score as the criterion. The 
stepwise regression formula was used to select tho best three 
predictors (out of the eight criteria) to predict the must reading 
score. 

For all physicians combined (odi tors , acadomi cians and 
practitioners), critoria 4, 1 and 8 in that order, were generally the 
best predictors. These same three predictors were typically found 
when editors, academicians arid practitioners were studied separately. 
The three groups were suprisingly alike in terms of which three 
preditors were effective and in terms of their overall predictive 
vaiue. 
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Apprnisal of th e_ C 1 inical RQlevanco Critor i a S v s t e m 

All physicians who cvuluated articles using the clinicnl 
relevance criteria^ then completed a form to evaluate those 
criteria, Some of the main results of that evaluation are 
summarized here . 

Most of the physicians (59 to 10) favored weighing some 
of the criteria more heavily than others. The criteria rocom- 
mended for the heaviest weighting were 4, 3, 1 and 7 in that 
order* Most physicians (68 to 12) indicated that the clinical 
relevance criteria system has intrinsic merit* Most physicians 
(63 to IS) feel that thu differential evaluation of journal 
articles relative to specific target audiences is appropriate. 
Most physicians (51 to 20) opposed having a different system 
of criteria and opposed (56 to 12) having a totally different 
approach to article evaluation. 

Evaluation Criteria Ori|?inated by Raters Not Using The 
Clinical Rel ejy a nc e Criteria . 

Raters who Were not asked to use the clinical relevance 
criteria were asked instead to use their own criteria and to 
list those criteria. Tlie independently-originated criteria 
could be grouped into five major categories: importance 
(listed by raters 1372 times) , research design (listed 472 
' presentation (listed 423 times), topic (listed 363 

^ i= ^ A ; ; j and information (listed 280 times). 

The largest category, importance with 1872 responses ^ 
included importance to pr ac t i ce ,( 1 i s t ed by raters 547 times), 
relevance to many cases or doctors (listed 487 times) i general 
relevance - important vs. trivial (367 times) j value of article 
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limited (258;, relevance to important cases (123), rolovancc 
to only one type of physician (39), and relevance to recent 
pat lent (SI). 

In comparison to the clinical rolevancc critoria systom, 
the set of criteria originating with non-system raters was 
strikingly different in one rispoct: there was no difforentiai 
evaluation by typo of au'licnco except in regard to bnckground 
information. In addition the clinical rolevance criteria 
included topical intirest br timeliness (criterion 1), not 
mentioned as such by non-system raters, who did, howover, 
list interest as a criterion. 

Non-system users did list all of the other criteria which 
comprised the clinical relevance systern, although individual 
non-system users did not necessarily use the ontire set and 
many raters ased only a very few. Some non-system raters 
also originated criteria which wore not used in the clinical 
relevance.' criteria system. 
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The study wnB deoifpifKi to bririF eMidf^nce to bear on four quofitiona,' 
QiiGStlon 1, Do edltorn, aut^Gmician^ , and comriunlty hospital Dract- 
itioners have the same or diffpring perspnotiveo on "clinical rGlevajice", 
do they eeleet the sare matorial diffBront natorial wbnn pickinR 
artialas that they iudpe to be clinically relevant? 

In terns of their overall tendency to rato m^ticlcp an mwt reading^ 
in thslr speeialty fie3.d, editors r^vn a poni.tivn ratjnr 6].^ of the t^nie, 
acadeniioians of the time, and practitiorerp 5^^^.' of the time. For each 
of foTir outside fi^ldn, editors rave a pOFT + ive ra^inr 11^ of the timaj 
academicians 11^ of the ti^, and practitioners VH of the tine. For 
general m\nt readnnn; for primly phvsicians, erinors rave the ariiolen 
a positive rating Z154 of the tjrie, acsdemicians 185S of the tirnOj ajid 
practitioners 24^ of the tirie. Thus, edi^ora favorably viewed articles 
as TOJst residing in their Boecial+y fields with acar^^rd.cj.anD pivinr the 
least favorable ratinr. The three fi^oiirs of phyoieisms dj.d not differ 
appreeiably in terms of their ratinf? artncler^ as mst reading in each 
of four outj^ide fields. The nraetitionerf- were rcrt l?ko}/' to rate articler? 
positively ^or prinary physicians, and academcirrip were the least likely 
to rate articles positively for primary DhynJcians +o read, 

Aeademieiang who used the PMI criteria system rated artfleles pe^iitJve- 
about the same p^rcentaf^e of the timo an djd aeaderfr^iars who did not 
use the criteria. However, practitioners wno r^ed the nrHerIa rated 
consistently fewer articles as mst readjn^' than did the practitioners who 
did not use the criteria. Thus the practitioners who did not vse the 
criteria were discrepant (rated more ^tlcles po:?itively) frrm the 
practitioners usinf; the criteria, the acnde^niciMs ^isirf the criteria, and 
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the acadeTTiiclaris not nsinR criteria. 

The edltora, acariemici^s, and practitioners were hi^hl^r similar 
in the internal relationship that exists ainonp; the ratinps on oach of 
eight criteria to the imjst readine^ scor^. This similarity was described 
in the section of Results callGd ''Regression Analynic of Pffi Criteria". 

The part of question 1 pertaininf^ to whether edH.ors^ acadeTnicianB 
and praetitioners pick the sa^e individual at'tieles m must reading will 
be answered under question 2, 

Question 2. Does the clnnieal relevance eritnria .system facilitate 
making consistent judgements of clinical relevance^ 3,^*, is there -reater 
intergroup reliability ajnon^ userp of the syptem than mom those who 
had to rely on their ovm critoria? 

Editors, all of whom used the cliniral relevanoc criteria system were 
compared to academicans and practitioners ^ half of whom used and half 
of whom did not use the criteria system. Across the three sets of nnist 
reading scores (snecialty fields outside fields, Md primary pJ^^sicians) , 
the average of the Qorrelations between thv^ editors rnfl t>"e agadeTnicans 
and practitioners who used the criteria was ,27. The avpT^afre of the 
correlations between the editors and the acadeinici.ars and practitioners 
who did not use the criteria system was .?3, Thus the ainoi^nt of arrreement 
between the editors and the aeademicans and practitioners was rather low 
reg^less of whether the latter two proups need the el^nicfil rele^^ance 
criteria. 

The correlations for the must resdinfc rating between academicians and 
practitioners who used the clinlQal relevance criteria were f or opecialty 
field seore^ .60 for the outside fields acore a-d for the nrimiry pl^sicans 
general reading' score. The amount of af:ree*^5nt was reaaonabla on the latter 
Q two scores, 
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The correlations for the miist reading ratinits between academcians 
and practitioners who did not use the criteria were .35 for the special- 
ty fields score^ .41 for the outside fields score and ,20 for the prirmi^ 
physlclane general resdjng score. Thus the arriount of agreement on the 
rating of Individual articles was only moderate on the first two scores 
and was low on the last score. 

Overall^ therft was more agreement between academicians and pract- 
itioners who used the criteria than between thjse who did not ~ that is, 
the averan:© of the correlations between criterion users was .^4^ and 
between non-users vms ,32. This higher agreement between criterion 
users, however, was limited to the outside fields ratinp-s and to the 
Feneral ratings for primary physic ians. 

A second set of analyses was done to compare users and non-users 
of the criteria on their ratings of articles as "must read.jng, The cor- 
ralationo between aGademicians who were users and non-users of the criteria 
system were ,34 for specialty field sco^e, ,^1 for outside field score, 
and ,39 for the general rating; for primainr physicians. The correlations 
betx^een practitioners who were users arid non-users of the criteria system 
were ,28 for the speoialty field score, ,24 for the outside fields score, 
and ,03 for the general rating for pri mai-^ p>rrsicisns. Thus there was 
mora agreement amonf: academicians than amon,^ practitioners in their rat- 
inps of individual articles - that is, the averape of the correlations was 
.41 for acajrismlcians and only ,18 for practitionei-s. The amount of agree- 
ment amon,^ users ^id non-users was moderate for aoadeTnicians and low for 
practitioners. 

In surmarlging the answers to Questions 1 and 2, it seems that the non 
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use of the clinical rtilevance criteria results in the prsjctitioners • 
ratinp; th© articles a bit hir^h, and in thair helng somewhat discrepant 
in rating individual articles when comnared to practitioners who used 
the eriteria and to academieians regardless of whether they med tho 
criteria. The practitioners who used thn criteria were rather consistent 
with both pv^oups of acariemiclanfi in their overall tendency to rate art- 
icles positively. The latter three groups were Tnoderately coneistent 
in their tendency in rating the saTne individual artjc3.es as rmjist reading. 

In short I the clinical relevance criteria systeni seens to help when 
the raters are practitioners , but seems to have little effect on ratings 
when the raters are academiciajis. 

Question 3. Does the system as a whole or parts thereof^ have valid 
predictability in terms of an avaluator's overall ^iudgeTnent of an article's 
clinical relevance? 

The imalyGes of *'must reading" ratings were undertaken under Question 
2, The following analyses will pertain to the interval relations of the 
clinical relevance criteria system (see Appraisal of ArtJcle Evaluation 
System CRLS 23 in Appendix A J 

The three be^t fj^^^^d^ctors (out of t>M? ^i^rht criteria) were used to 
predict the must readiniC^ score. As there was little difference between editors, 
academicians, Di^actltioners, the resulto nrnsented for all of them com^ 
bined. The multiple oorrelation value between the three best precliutc?r^ and 
the must reading ratin^^ arm ,62 for the specialty fieTri score , ,64 for the 
outside fieldL^ scoru, and ,52 for the general ratin,^ for prjma^ physicians. 
The first two are mirderately high and the latter is moderate. Perhaps it js 
a bit difficult to apply the rather specjfic individual criteria in the 
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general case of the general rating for primT^^ physicians. 

The interval consistency is reasonable for the thr^e criteria (4, 1 
md 8) and their relation to the must readin/^ score. For the purpose of 
slfnply predicting the must reading score, these three criteria are the 
only ones necessary « adding the other five does little to increase the 
predictions, as their information may be statistically redundant vrith the 
three best predictors, 

Chaestion Does the criteria system facilitate making differential 
judgements of a given article ^s clinical relevance Lo more than one specialty, 
particularly with respect to identifying ^j^tentially %^aluable articles for 
one specialty that may be published in another specialty's Journals T 

Yes, somewhat. On the must reMing score, for criteria users, the 
correlation between academiQians and practitioners was .60 f-r the outside 
fields score md was .48 for the general rating for primary physicians. For 
non-user^ the correlation between aoademiclwg and practitioners was ,41 for 
the outside fields score and ,20 for the ,^eneril rating for primat-/ physicians. 
Thus there was more agreement (reliability) between academiclims and pract- 
itioners when they used the clinical relBvajice criter:)a. This effect seems " 
to exist because practitiOTers who did not use the criteria rated articles 
rather unlike the other groups of physicians. 

It should be kept in mind that soine specialty fields such as general 
practice have niany articles which are suited for other specialist while other 
fields such as obstetrics-,^ecology have only a few articles suited for out- 
side specialists. 
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General Dlscvisr.ion 
men practitioners rated articles for must reading, their ratings 
were more similar to other groups of physicians when the praetitioner'i 
used the eiRht clinical relevance criteria than when thny did not. The use 
of the criteria made little difference for anademiciar.s. Thus the criteria 
appear to help the practitioners but do not aff»»nt t>ie academicians approc- 
iably. 

Considerable evidence exists in this report that can be used to revise 
the system of clinical relevance criteria or develop a new Gysten. It 
seems feasible to have fewer than eight eritorla - only three were nsieded 
to predict the must reading fjnore. Perhaps five criteria - somewhat re- 
vised from the existinR ones - would suffice nicely for the purpose of rating 
inedical .iournal articles for clinical relevaiice. 

In this study, individual articles were rated by ptoutjb of raters 
averaging 3.5 physicians in size. The key protalftF! is that the rating groups 
were in only m.oderate agreement with one another as to which individual 
articles T^.ere considered to he must reading. The present system or a 
facimile thereof would not be reliable (preciso) enough to rate all the 
articles in a .iournal well enough to have the ratin?R be worthy of publi- 
cation. The present system is precise: enough for tha purposa of locating 
the small number of artioles that the raters can agree on as being must 'i 
reading. A system can be imprecise in general ^ ye-t be suitable for locating 
artJOles in either extreme of popularity. Such an arproach would seem 
suitable for locating articlea for a core list or library or for the pre- 
psj-ation for a madical exam as was illustrated in +h.is study. 
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An alternate system designed to select a small percentage of articles 
for imiit reading, might in\'olve making a rough sort of all the artinles 
into a moderate siied pile of "likaly csmdidat-js" that then could be rated 
inore OM'sfrlly by a group of physicdars to determne the final selection. 

For the purpose of developing a morm precise ratini^ system, tiie 
followinf; procedures should prove helpful- 

1, Posaibly the ratc^rs could be selected or trained In a way to 
increase their agreeirent on rating individuan articles. 

2, The number of raters in a group could be soinewhat larger than 
the present study's average ^oup si^e of 3.5. 

3, Insteai of there being a ''must readinr" vb, "not must reMini^" 
choice, there could be, say, a five point bqbIb ranging from 
"definitel^y not must reading" to "definitely must reading.'' 
This latter scale would enable a rater to more precisely express 
his opinion of the article. 

Even with one or more of the above three recommendatd.ons, it cannot be 
guaranteed in advance that all the articles in a journri could be rated 
precisely enough that the results could be publishr?d « the system would 
have to be tried and examined first. 

There were fewer articles recommended for "must reading" in individual 
outside specialties than in the journal's specialty field. In obstetrics- 
gynecolo.^s^i articles were recommended for "must reading" by a given outside 
specialist only 9^ of the time. Perhans only 2 or 3# of the articles would 
turn out to be a?^eed upon by the ratinp f^roup as being must reading for 
a given outside specialist. In general prn/^tice, the mimber of articles 
that could bs s^eed upon m miBt reading for a. given outside specialist 
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would be higher. The returns, in this sense, would also be rather low 
in sur^er^ and sjrDewhat limited in Intfsrnal mei^jcine and pediatrjcs* A 
low rate of return does not necessarily Imply low IrrrportanCG, (See right 
had col^^nai of Tables 6 and 8, ) 

Articles were also rated for general m^t reading by prirnary physiciana. 
The pereentage of articles positively rated ran^e from 16^ in Siirgery to 
35^ in general practice, Th^ percentape of articles that could bo a^^reed 
upon by a group of raters would definitely be ]ower tha^ these fif^ires, (See 
the right hand colnmn of Tables 6 and 9.) However^ with a two stan:e sorting 
system, as described above, it mRht be possible to locate extreme articles 
for general must reading by pHinai^ physicians* 

A systeni of selecting ^ticles would result in the largest number of 
"must reads" when the articles were rated for specialists in the Journal's 
spedlalty field. The percentage of articles rated for "must reading" in 
the journal's specialty field ranged from k-lf^ in obstetries-^mecolo/Tj/ to 
56^ in pediatrics. (See Tables 6 and 7*) A mch smaller percentage of 
individual articles, however, would be actually afrrced upon by a rating group 
as must reading in their specialty field under the present rating system. 
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Article Hvaluation Forni (CRLS 43) 



POSTGRADUATE MEDICAL iNSTITllTE 
30 The Fenway 
Hoston, Mass. 02115 



ARTICLE EVALUATION FORM 
Clinical Relevan'^e of Published Articles for Multiple Audiences 



Expiration Pate ..June 30, 1071 
Form CRLS 43 



Title of Articli 
Name of Journal 
Senior Author 



Jiatf of Publication 
Page 



Mo. 



Day 



Year 



nn this sheet, please rate the clinical rolevance of the article to each of the following 
six (6) target audiences' 

G = General Practitioners 0 - Obstetrician-Gynecologisti 

I ^ Internists S ^ General Surgeons 

P s ^Pediatricians GIPOS = Confined Group acting as Primary Physi clans 



CRITERIA 



POSSIBLE SCORE 

1 to 6 points 
C6 is highest value) 



AWARDED SCORE 

Award points by circling one 
Nunfcer in Each Box Below: 
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2, Comprehens ibi lity of article 
to each audience (i.e.j not depen= 
dent on specialized knowledge) 



Score each target 
audi ence i ndependent ly 



3. Frequency of applicability of 
article's information to the clinical 
practice of each audience Ci^e., how 
often will the information be used) 



Score each target 
ludience independehtiy . 



4, Significance of article's 
information to the clinical 
practice of each audience (i.e. 
potential impact on care of 
individual patients) 

5. Adequacy of article's back- 
ground explanation for each 
audience (i.e.* how well is the 
topic area explained) 



Score each target } 
audience independently 



3 
4 
S 
6 



Score each target I 
audience independently I 



6. Originality of article's 
information (i^e., how new is the 
knowledge) 



7, Validity of article's infor- 
mation (i.e,, are statements* claims 
and conclusions well supported) 



8. Quality of writing (i.e., style, 
is distinct from comprehens ibility) 



Same score for 
all target audiences 



Same score for 
all target audiences 



Same score for 
all target audiences 



1 

2 
3 
4 
S 
6 



1 

2 
3 
4 

S 
6 



3 4 



1 2 3 4 S 6 



3 4 B 6 



OViiRALL ASSESSMENT: The clinical value of this article warrants its recommendation for 
priority ("must") reading by the following target audience (-^1- 



Circle letters corresponding 
to recommended audience (s) 



GIPOS 



GIPOS 



NONn 



Name (print)_ 



Position 



All information regarding individuals and thair views or opinloni will he hold in 
strict confidence. Only statistical summaries of the study'.s results will be published. 



Appondix A 
Article Evaluation Farm (CRLS 63) 



POSTGRADUATE MEDICAL INSTITUTE ^ O n # fifl o^r^n-rA 

ARTICLE EVALUATION FORM 
CUnical Relevance of PubUihed Artlclei for Multtpla Audiancei 

Title of Article 



Name of Journal Pate of Publication^ 

Mo Day Year 

Senior Author Page 

On this aheetp please rate the clinical relevance of the article to each 
of the following six (6) target audienceii 

G ^ General Practitioners O = Obstetrician-Gyneeologiiti 

I ^ Interniflti g s General Surgeons 

P ^ Pediatriciana GIPOS = Combined Group ai Primary 

Physiclana 



QVERALL A.1SESSMENT; ThM elinical value of this artlcl§ warrants its reeanmendatlon for 
prioritj^ C^imsV*) reading by the following target audience (s] ^ 

Circle letters correipondlng r t d a e 

to recommended audience (s) U I P O S GIPOS NONE 



Please Hit below the criteria you utilized to evaluate the clinical relevance of this 
article. List the criteria in order of Importance with the moit important firsts 



2. 

7. 
8. 



(Use reverse lide if additioniLl space is neaded. ) 
N^"^^ Title 



All information regarding indlviduali and their viewg or opinions will be held in itrict 
confidence* Only statistical lummaries of the study*s results will he puhlish«*d. 
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Appraisal of Article Ovaluati on,^ Sys t ems 
(CRLS 233 ' 



POSTORADUATE MEDICAL INiTlTUTE 



1,0. B. # 68-570074 



30 The Fenway „ « _ ^ . 

iQSton, MafiMchuietts 02115 Es^iratien Data - June 30, 1971 

Form CRLS 2 J 

APPRAISAL OF ARTICLE EVALUATION SYSTEM 

Having used the Artleie Evaluatien Fsfm, pUaie indicata your reactiona 
to it by aniwering the following questioni^ 

A. WhRt, if any, additional criteria would you add to tht present lyitem? 
1, 



B. Which, if anyi of the criteria would you omit from the present syatem? 



Please state reaion(i): 



C, Should one or more of the listed eriteria be weighted more heavily than others, 
1, e* , carry more importance t 

Yei Nq_ 

If Yes, please elaborate (inciuding your recommendations for relative weight 
or importancej. 



D, Do you think that thii journal article evaiuation system has intrinsic merit? 

Yes No 

Please commentt 



Do you feel that tht dlfferentisl eviluatien of journal artlcUi relative to 
specific target audieneei if appropriate? 



yei_ No 

Pleafe explain: 



Would you prefer a different iystem of criteria? 

Yis__ 

If Yes, pleaaa describe; 



Would you prefer a totally diffirent approach to article avaluation? 

Yei_ ^No 

If Yeii please da§cribe; 



Additional oommenti (Use back of sheet if further space ii neaded): 



No 



Name 



Title 



All information regarding individuals and their views or opinions will be held in strict 
confidence. Only statistical summaries of the gfcudy'i rasuUi will be pubnshed, 



I 
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SAMPLE COVER LETTER 



CRLS 4a 



TO ACADEMIANS USING CRITERIA ^IShWt #X?„m.^ « 

-■ :_ - " — — — . ~_ •Ri9ppt«<T 

j 

j POSTGRADUATE MEDICAL INSTITUTi 

; UNOiR SPONSORSHIP Ot TMi MASSACHUiETTS MEOICaL SOCIiTY ^0 FINWAY. BOSTON, MASiACHUSETTS aSJlB TEL, (617) S6J-3040 



lERIC 



John JOnes ^ M , D , 
1 Boston Place 
Boston 5 Massachusetts 

Dear Dr . Jones : 

Thank you for agreeing to participate in Postgraduate Medical 
Institute's project to develop a method for identifying the journal 
articles most relevant and applicable to clinical practice. The 
goals and objectives of the project, which we have entitled ''Clin- 
ically Relevant Literature Study*% are summarized in the accompanying 
Introduction to Participants . 

General Practitioners, Internists, Pediatricians, Obstetrician-' 
Gynecologists, and General Surgeons are ifrequently called upon to 
function as primary physicians^ as well as specialists, A system to 
evaluate journal literature for such physicians should, therefore, per- 
mit one to simultaneously and differentially evaluate the potential 
value of a given article to both the common knowledge needs of priniary 
physicians and the unique knowledge needs of specialists, A number 
of editors i medical academicians, and practitioners helped formulate 
a system of criteria for evaluating the clinical relevance of an 
individual article to the five types of specialists: General Practition- 
ers CG3i Internists (I). Pediatricians (P) , Ohstrtrician-Gynecologists 
(0], and General Surgeons (S), as well as its relevance to these same 
specialists serving as prima:ty physicians CGIPOS] . 
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We are now asking you to ^sist with the furthsr development 
of the system by performing two key tasks: 

1. Review the articles in the i gftue □£ 

^. — _ — _■ - -■ — a copy of which 

IS enclosed. Please assess the clinical relevance of every article 
in the issue to each of the six target audiences CG,I|P,0,S, GIPOS) 
by completing one of the enclosed yellow ARTICLE EVALUATION FOW^IS 
for each article, 

2. Appraise the evaluation system itself. After using the 
system to evaluate the articles in the designated issue, then use 
the blue APPRAISAL OP ARTICLE EVALUATION SYSTEM FORM to expand or 
reduce the list of criteria, to alter the point weightings asso- 
ciated with individual items, and to offer any comments, reactions, 
or modifications which you think will be helpful. 

We realize that this is a significant task to add to your already 
crowded agenda. However, since we are working under severe time 
pressures, we hope that you will find time to respond within thirty 
days. If you have any questions please do not hesitate to call me or 
W associate, Mr. Robert Gold, at (617) 262-3040. Please use the en- 
closed postage-paid envelope to return the completed forms. The 
journal issue need not be returned, IVe will be pleased to supply 
additional forms if needed, 

Thank you for your help. Your response will be held in strict 
confidence* Any report of the study »s results will reflect only 
aggregate data, We are grateful for your cooperation and assistance. 



Sincerely , 



Norman Stearns, M,D, 
Executive Director 



Enclosures 
NSS/mg 
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Sample Cover Letter (CRLS Sa) 
to Academicians Not Using Criteria 



SAMPLE COVER LETTER 

TO ACADEMICIANS^OT USING CRITERIA ^.IMJA 



vieiJSRiiiBlfiT 



POSTGRi^DUATE MEDICAL INSTITUTE 

UNPiR SPeNiORSHIP OF TNE MASSAeNUSETTS MIDICAL SQCIfTY 3° "^fi^^AV, BOSTON, MASSAeHUliTTi 02218 TIL, (ilf) 262^04© 



George Smith, M,D. 
3 Elm Street . . 
Boston, Massachusetts 

Dear Dr, Smith: 

Thank you for agreeing to participate in Postgraduatt Medical 
Institute's project to develop a method for identifying the journal 
articles most relavant Bnd applicable to clinical practice. The 
goals and objectives of the project, entitled "Clinically Relevant 
Literature Study", are suraniarized in the accompanying Introduction 
to Participants , 

General Practitioners^ Internists, Pediatricians, Obstetrician- 
Gynecologists and General Surgeons are frequently called upon to 
function m primaty physicims, as well as specialists* A system to 
evaluate journal literature for sudi physicians should, therefore, 
permit one to simultaneoi^ly and differentially evaluate the potential 
, value of a given article to both the common knowledge needs of pri- 
mary physicians md the unique knowledge needs of specialists. We 
are inking a number of editors, medical academicians, md practitioners 
to help formulate a system of criteria for evaluating the clinical 
relivance of m individual journal article to the five types of 
specialists: General Practitioners (G) , Internists (I), Pediatriciwis 
(P) , Obstetricimi-Gynecologists (0), and General Surgeons (S) , as 
well as its relevance to these same specialists serving as primary 
physicians (GIPOS), 
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We are now asking you to assist with the further developnient 
of the system by performing two key tasks: 

1. Review the art\cles in the ■ issue of 

. _ . a copy of which is 

enclosed. Please assess the clinical relevance of every article in 
the issue to each of the six target audiences (G* I, P, 0, S, GIPOS) 
by completing one of the enclosed pink ARTICLE EVALUATION FORMS 
for each article. 



2, On the same form, please list, in order of importance, the 
criteria which you used to decide whether or not an article should 
be recommended for priority reading by the various target audiences. 

We realize that this is a significant task to add to your already 
crowded agenda. However, it would be most helpful to us if you could 
respond within thirty days. , If you have any questions please do not 
hesitate to call me or my assoeiate, Mr, Robert Gold, at (617) 262-3040. 
Please use the enclosed postage-paid envelope to retam the completed 
forms. IVe will be pleased to supply additional forms if needed. 

Thank you for your help. AH information regarding individuals and 
their views or 6pinions will be held in strict confidence. Only 
statistical siMmaries of the study^s results will be published. 

We are grateful for your cooperation and assistance. 



Sincerely j 



Norman S. Stearns, M.D, 
Executive Director 



Enclosures 
NSS/mg 
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SAMPLE INTRODUCTION TO PARTICrPA NTS 
CRLS 15 FOR* ACAUEMICIANS U SING CRTTFRTA " 



Wm/kMH P, FQlTEft, M.B, 
MILTON 
NBNM&N STEARNS. M.B. 

EXEeyTiva BmicTQis 

□ EQRSS T, NIUiQN 

RPCMARB A. CARTER 
AiSfSTANT pmEerSR PQR 
FiNANeiAk AFFAIRS 



POSTGRADUATE MEDICAL INSTITUTE 

UNDER SPONSOBSHIP OF THI MASSaCHUIITTS MEDICAL SOCIITV 3° FBNWAY. BOSTON, MABaACHUSBTTS 0231B TiL. (617! 382-0040 

CLINICALLY RELEVANT LITERATURE STUDY 

A Study to Develop Criteria for Identification of 
Journal Literature Relevant to Clinical Practice 



Introduction to Participanta 

The conscientious medical practitioner has always faced a formidable 
task in satisfying his need and desire to remain abreast of current 
medical knowledge. His problem has been intensified by the scientific 
knowledge explosion of recent years. The accompanying proliferation 
of medical literature has brought with it naw or broadened areas of 
immediate relevance to His clinical practice. The practicing physician is 
frustrated by the need to devote a disproportionate amount of his available 
reading time to screening the mass of publiihed material for those bits of 
information most critical to his needs. 

General Practitioners (G), Internists (I), Pediatricians (P), Obstetrician- 
Gynecologists (O), and General Surgeons (S) may serve both as primary 
. physicians and specialists, and therefore must be fully aware of significant 
medical advances, not only in their own fields, but in other areas which 
relate to the general care of their patients. The bulk of their time and 
energy must of necessity be spent diBpensing their services, permitting 
little time to search for essential information. 

t^i^^ Library 1 developed by Postgraduate Medical Institute 

(PMI) IS one attempt to present an organized, easily accessible set of 
books and journals encompassing the clinical practice of medicine However 
even this highly select collection (48 books and 39 journals) presents a 
formidable amount of material for regular and effective review. A physician's 
reading efforts would be more productive if he could readily identify that 
journal material most relevant and applicable to his clinical practice 
Accordingly, PMI is attempting to identify and establish criteria which 
editors and consultant specialists could use to select those specific journal 
articles which deserve priority reading by practicing physicians. It is 
hoped that selective application of appropriate criteria would permit identifica- 
tion of articles Important to doctors serving either as specialists (G, I, P, O, 
or S) or in their collective roles as primary physicians (C^^OS). ' ' 

Stearns, N.S. , Ratcliff, ,W. W. : A Core Medical Library for Practitionars 
^ m Community Hospitals'. New England Journal of Medicine. 280: 474-^80 1969 
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The Division of Physician Manpower, Bureau of Health Profesaions 
Education an4 Manpower Training, National Institutes of Health, has 
acknowledged the potential utility of such an approach to the objective 
identification of clinically rele vant literature and has authorized 
PMI to pursue it. As a preliminary step, and with the assistance of a 
limited number of editors and consultants^ PMI has established a set of 
criteria as a basis for evaluating the clinical relevance of individual 
journal articlfes* However, we feel that a system of criteria for this 
purpose must be evaluated and modified by journal editors and 
consaltants who have knowledge, sklUp and experience relative to the 
selection, publication, and use of medical literature, and who will be 
objective and critical in their use and review of the system itself. 
In this context, PMI sees itself largely as a catalyst, stimulating and 
coordinating the collective expertise of those who are most familiar 
with the generation of journal articles and the needs of the medical 
practitioner. It should be stressed that the goal of this study is 
the development of criteria that will lead to the identification of 
certain material relevant to the most urgent needs of a particular 
group of physicians j and that it is not the intent of PMI to provide a 
basis for limiting or selecting material to be published, 

PMI is seeking the cooperation of consultant specialists who are 
experienced in reviewing material submitted for publication in prominent 
medical journals. We are asking that these consultants review the 
material published in selected journals during a limited period, that 
they use PMI's proposed system to evaluate the relative clinical 
importance of the articles in the designated issue(s), and that they 
critically assess the article evaluation sy stern itself. This procesi 
should, ultimately yield an identified body of selected journal 
literature and a system of criteria capable of permitting committed 
selection of further literature pertinent to the clinical needs of 
pi acticing physicians. 
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Introduction to Parti cip ants (CRLS 16) 
for Academicians Not Using Criteria 



'CRLS 16 SAMPLE INTRODUCTION TO PARTICIPANTS 

FOR ACADEMICIANS NOT USING CRITERIA 



Vie* pRfciieiNT 

CXEfiUTiVl BiitieTSR 

RieMARB Ai eAHTEM 
rINANeiAL AprAlHS 



POSTGRADUATE MiDICAL INSTITUTE 

UNDIR SPONSORSHIP OF THi M ASSACHUSiTTS M E D I C AL S Q Gil TV 3° ^^"^^^"^^ BOSTON, MASSAGHUSiTTS 0221 S TEL. f6l7) ^a3^304Q 

CLINICALLY RELEVANT LITERATURE STUDY 

A Study to Develop Criteria for Identification of 
Journal Literature Relevant to Clinical Practice 



Introductiotf 'to Participantg 

^he ^conscientious medical practitioner has always faced a formidable 
task in satisfying hie need and desire to remain abreast of current 
medical knowledge. His problem has been inteniified by the explosion 
of scientific knowledge in recent years. The accompanying proliferation 
of medical literature has brought with it new or broadened areas of ^ 
immediate relevance to his practice. The practicing physician is frustra- 
ted by the need to devote a disproportionate amount of his available 
reading time to screening the mass of published material for those bits 
of information most critical to his needs. 

General PractitionersCG), Internists (I), Pediatricians (P), Obstetriciai 
Gynecblogists (O), and General Surgeons (S) may serve both as primary 
physicians o,nd specialists^and therefore must be fully aware of significant 
medical advances, not only in their own fields, but in other areas which 
relate to the general care of their patients. The bulk of their time and ^ 
energy must of necessity be spent dispensing services, permitting little 
time to search for essential information. 

The Core Medical Library ^ developed by Postgraduate Medical 
Institute (PMI) is one attempt to present an organized, easily accessible 
set of books and journals encompassing the clinical practice of medicine. 
However, even this highly select collection (48 books and 39 journals) 
preaents a formidable amount of material for regular and effective review, 
A physician's reading efforts would be more productive if he could readily 
identify that journal material most relevant and applicable to his clinical 
practice. Accordingly, PMI is attempting to identify and establish criteric 
which editors and consultant specialists could use to select those specific 
journal articles which deserve priority reading by practicing physicians. 
It is hoped that selective application of appropriate criteria would permit 
identification of articles importaiit to doctors serving either as speciallsti 



^ Stearns, N. S. , Ratcliff, W, W. • A Core Medical Library for Practitioners 
i:D?r" Community Hospitals. New England Journal of Medicine. 280i 474*480, 1969. 
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{Gt Ii Pi O, or S) or in their collective roles as primary physicians 
(GIPOS). 

The Division of Physician Manpower, Bureaa of Health Professions 
Education and Manpower Training, National Institutes of Health, has 
acknowledged the potential utility of such an approach to the objective 
identification of clinically relevant literature and has authorized PMI 
to pursue it* PMI feels that criteria can be articulated best by editors 
and consultants who have knowledge, skill and experience in both medical 
practice and in the review and selection of medical literature for 
publication. In this context, PMI sees itself largely as a catalyst, 
stimulating and coordinating the collective expertise of those who are 
most familiar with the generation of journal articles and the needs of 
the medical practitioner. It should be stressed that the goal of this 
study is the development of criteria that will lead to the idantlfic^ion 
of certain material relevant to the most urgent needs of a particular 
group of physicians and that it is not the intent of PMI to provide a 
basis for limiting or selecting material to be published, 

PMI is seeking the cooperation of consultant specialists who are 
experienced in reviewing material iubmitted for publication in prominent 
medical journals. We are asking that these consultants review the 
material published in selected journals during a limited periodj that 
they assess the clinical relevance of the published articles for the 
various groups of practitionerSi and that they clearly indicate the 
criteria they used in determining the relative clinical merit of each 
article* This process should, ultimately, yield an identified body of 
selected journal literature and a system of criteria capable of per- 
mitting committad selection of further litGrature pertinent to the 
clinical needs of practicing physicians. 
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Bample Letter to Non-Respondents 



FOrni CRLS 70 



Version 1| Editors and Consultants 



ROBERT p. MCeSMBS. M,n, 
FRANK p. rOSTER^ M R, 

vscfi PRgsrneNT 

llXECUtrVE niRfrCTQR 
fifiORGE T. NiLSON 

FitLR bihe;ctor 

FtlrWAMf"^ A. CATfTrR 
ASSISTANT DirtrcTilH r?5R 
PlNANCfAL AFrAIRS 



POSTGRADUATE MEDICAL INSTITUTE 

UNDIR S^ONSQflSHIp OF THl MASSACHUSETTS MEDICAL SOCIETV FENWAY, iOBTON, MASSACHUSeTTs Q221D TEL. (617} 2^2^3040 



Date 



John Smithy M.D* 
1 Sniith Street 

Boston, Massachusetts 01111 
Dear Doctor Smith, 

^Approximately six weeks ago, on the basis of our 
earlier discussion, we sent to you the materials pertaining 
to your participation in Postgraduate Medical Institute's 
project to develop a method for identifying the journal 
articles most relevant and applicable to clinical prac-- 
tice. We had asked and hoped that you would take the 
time to respond within thirty days/ 

Time and budgetary considerations, and the personal 
nature of this phase of our study, have forced us to 
sharply limit the nuitODer of participants* Therefore, it 
is imperative that we obtain a response from each person 
^o originally agreed to help us. "we cannot analyEe our 
data as planned or proceed with the next phases of our 
study until we have your completed forms* 

If you have any questions or need additional materials, 
please call me at (617) 2 62-^3040* I am sorry to press 
you, but in this instance your role is really essential. 



Sincerely, 



Merman S- Stearns, M.D. 
Executive Director 
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Table 1 

Three-Way Analysis of Variance Comparing Groups 
of Physicians on Specialty Field Score 



Source of variation df MS 



PMI v|_. non-PMI (Variable A) 


1 . 


1 


.371 


6 


.198* 


Academicians ys^. practitioners 


(B) 1 . 


2 


. 109 


9 


. 533** 


Five specialty fields (C) 


4. 


0 


. 392 


1 


.773 


A6 


1 . 


0 


.187 


0 


.843 


AC 


4. 


0 


191 


0 


.861 


BC 


4. 


0. 


662 


2 


.990* 


ABC 


4. 


0. 


374 


1 


.692 


Error 


748. 


0. 


221 


1 


000 



p .05 
p .01 



Note,-» Specialty Field Score is defined as the proportion 

of' each group of physicians who rated journal articles 
in their specialty field as must reading for 
practitioners 1n that field, 
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Table 2 

Three-Way Analysis of Variance Comparing Groups 
of Physicians on Outside Fields Score 



Source of variation 


df 




M£ 






PMI vs . non PMI (Variable A) 


1 . 


0 


. 1 73 


7 


.904** 


Academicians y^s . practi tioners 


(B) 1 . 


0 


1 58 


7 


. 234** 


Five specialty fields (C) 


4. 


1 


1 48 


52 


436** 


AB 


1 . 


0. 


018 


0. 


835 


AC 


4. 


0 . 


073 


3 . 


3?1* 


BC 


4. 


0. 


040 


1 . 


B04 


ABC 


4. 


0. 


0 68 


3 . 


090* 


Error 


748. 


0. 


022 


1 . 


000 



*p .05 
p .01 



Note,-" Outside Fields Score 1s defined as the proportion of 

each group of physicians who rated journal articles in 
their specialty field as must reading for practitioners 
in each of four outside fields. 



APPENDIX B 
Table 3 

Three-Way Analysis of Variance Comparing Groups 
of Physicians on the Six Categories Score 

Source of variation df MS F 



PMI vs_. non-PMI (Variable A) 


1 . 


0 


.740 


5 


.475* 


Academicians vs. practitioners 


(B) 1. 


0 


. 523 


3 


.865* 


Five specialty fields (C) 


4. 


0 


.722 


5 


.338** 


AB 


1 . 


0 


.132 


0 


.974 


AC 


4. 


0 


. 242 


1 


.788 


BC 


4. 


0 


036 


0 


. 264 


ABC 


4. 


0 


116 


0 


855 


Error 


748. 


0. 


135 


1 


000 



05 



p ,01 



Note,=- Six Categories Score is defined as the proportion of 

each group of physicians who rated journal articles in 
their specialty field as must reading for practitioners 
in each of the five specialty fields and in a general 
category including all five fields. 
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Table 4 

Two-way Analysis of Variance Comparing Groups of 
Raters Who Used the PMI Criteria on the 
Spadfllty Field Score 



Source of variation df MS 



Editors vs_. Academicians 
vs . Practitioners (A) 

Five Groups of Specialists (B) 
AB 

Error 



2. 


1 


.331 


4.410* 


4 . 


0 


.216 


0.717 


8. 


0 


.722 


2 .392* 


510. 


0 


.302 


1 .000 



05 



Note.-- Specialty Field Score is defined as the proportion 

of each group of physicians who rated Journal articles 
in their specialty field as must reading for practi- 
tioners 1n that field. 
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Table 5 



Two-Way Analysis of Variance 


Comparl ng 


Academi c1 an 


s 


and 


Practitioners Who Did Not Use 


the Clinical Relevance 


Criteria and Editors® on the 


S p e c i a 1 ty 


Field Score 






Source of variation 


df 


MS 




F 


Editors y%_. academicians 










vs . practitioners (A) 


2. 


0.929 


6 


.960** 


Five groups of specialists (B) 4, 


0.267 


1 


.997 


AB 


8. 


0.512 


3 


.831** 


Error 


511 . 


0.134 


1 


.000 



Note.-- Specialty Field Score 1s defined as the pro- 
portion of each group of physicians who rated Journal articles 
1n their specialty field as must reading for practitioners In 
that field. 

a. Editors used the PMI criteria in all cases. 
** £ .01 
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Table 6 

Two-way Analysis of Variance Comparing Groups of Raters Who 
Used the Clinical Relevance Criteria on the Outside Fields Score 



Source of variation 


df 


MS 


F 


Editors V£, academicians 








y±. practitioners (A) 


2. 


0.001 


0.047 


Five groups of specialists (B) 


4. 


0.632 


25.012** 


AB 


8. 


0.042 




1 .671 


Error 


510. 


0.025 


1 .000 



. Note.^ Outside Fields Score is defined as the proportion 
of each group of physicians who rated Journal articles 1n their 
specialty field as must reading for practitioners in each of 
four outside fields. 
** £ .01 
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Table 7 

Two-way Analysis of Variance Comparing Academicians and 
Practitioners Who Did Not Use the Clinical Relevance Cr1te 
and Editors* on the Outside Fields Score 



Source of variation 

Editors v£, academicians 
vs . practitioners (A) 
Five groups of specialists (B) 
AB 

Error 



H _MS F 



2. 0.089 3.686* 

4. 0.987 41.059** 

8. 0.085 3.521** 

511. 0.024 1.000 



Note." Outside Fields Score is defined as the proportion 
of each group of physicians who rated journal articles in their 
specialty field as must reading for practitioners in each of 
four outside fields. 

a. Editors used the PMI criteria in all cases. 

* £ .05 

** £ .01 



APPENDIX B 



Table 8 

Two-way Analysis of Variance Comparing Groups of Raters Who 
Used the Clinical Relevance Criteria on the Six Categories Score 



Source of variation 


df 


MS ■• 




F 


Editors vj^. acadeniiclans 










vs. practitioners (A) 


2. 


0.059 


1 


.803 


Five groups of specialists (B) 


4. 


0.460 


14 


.106** 


AB 


8. 


0.095 


2 


.908** 


Error 


510. 


0.033 


1 


.000 



Note.-- Six Categories Score is difined as the proportion 
of each group of physicians who rated journal articles 1n their 
specialty field as must reading for practitioners in each of 
the five specialty fields and 1n a geniral category including 
all fivefi elds. 



£ ,01 
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Table 9 

Two-Way Analysis of Variance Comparing Academicians and 
Practitioners Who Did Not Use the Clinical Relevance 
Criteria and Editors^ on the Six Categories Score 



Source of variation 

Editors academicians 
vs_. practitioners (A) 
Five groups of specialists (B) 
AB 

Error 



df MS_ F 



2, 0,308 1.657 

4; D*729 3.921** 

8, 0,097 0.523 

511 0.186 1.000 



Note,-- Six Categories Score 1s defined as the proportion 
of each group of physicians who rated journal articles in their 
specialty field as must reading for practitioners in each of 
the five specialty fields and in a general category including 
a 1 1 f 1 ve f 1 el ds . 

a. Editors used the PMI criteria in all cases, 

** p .01 
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Appendix C 



Articles Used as Data Base for 
Sample Se 1 £ -Ass e s s men t Exam Question 



Articles Used as Data Base for Sample Sa 1 f -As s eg snien t 
Exam Ques ti ons 

[Journal, Volume, ''umber, Publication Date, Article Title, 
Author) 



American Family Phy^s i cian/GP Volum© 2, Number 5, November 1970 

Ankylosing Spondylitis 

John F. Calabro, Bertram A. Malts, Paul Sussman 



Management of Respiratory Failure 
John A* Kibelstis 

The Peripheral Blood in Malignancy 
0 ^Neill Barrett , Jr. 

Care of Common Foot Problems 
Rene Cailliet 

Diagnosis and Management of Flu 
Mary M , Carruthers 



New England Journal of Medicine Volume 283, Number 19, 1979, 

November S , 1970 

Artifi.cial Cardiac Pacemakers 

Bernard Town and Bernard D* Kosowsky 

Reserpine in Thyrotoxic Crisis 

Pauline T. Dillon, John Babe, C,R, Meloni, and 
John J. Canary 

Psychiatric Complications of Open-Heart Surgery 
Stanley Heller et al, 

Home Transfusions for Patients witli Hemophilia A 
S. Frederick Rabiner and Margaret C» Telfer 

Necrotizing Angiitis in Drug Addicts 
B. Phillip Citron et al . 



Anjials of Int ernal Medicine Volume 73, Number S, November 1970 

Rubella Virus Vaccine - Recommendation of the Advisory 
Committee on Immunization Practices, U,S* Pub lie 
He al th Servi ce 



Annal 5 of Internal Medicine (continued) 



Pentamidine Isethionate in the Treatment of 
Pneurngpystic Carini Pneumonia 
Western, Perera, Schults 

Centrilobular Hepatic Necrosis and Acute Renal 
Failure in .''Solvent SniffersJ- 
Baerg, Kimberg 

Pathophysiology and Therapy of the Shock of 
Myocardial Infarction 
Haddy 

Recent Advances in Immunization Against Viral Disease 
Stokes 



The American Journal of Medicine Volume 49, Number 4, October 1970 

The Pacemaker Sound 

Morton Korn, Clyde D. Schoenfeld, Ali Ghahramani, 
Philip Samet 

Exercise- Induced S=T Segment Elevation, Clinical, 
Electro-cardiographic and Arteriogr aph i c Studies in 
Twelve Patiants 

Nicholar J. Fortuin, Gottlieb C* Friesinger 

Zoster, Reinfection or Activation of Latent Virus? 
Observations on the Antibody Response 
Laurence H. Millei% Philip A. Brunell 

Hypertension and the Lupus Syndrome 

Washington University School of Medicine 

Pseudocoarctation of the Aorta, An important Consideration 
in the Differential Diagnosis of Superior Mediastinal Mass 
Tsung 0, Cheng 

Pediatrics Volume 46, Number 5, November 1970 

Kidney Transplantation in Children 

M* P. LaPlante, J.J. Kaufman, R. Goldman, IL C . Gonick, 
D. C, Martin, IV*E. Goodwin 



Ilodgkin's Disease in the First Decade 
S. Strum^ H. Rappapoft 



Pediatri cs (continued) 



The Criticall/ 111 Child, XIV, Disseniinated 
Intravascular Coagulation 
W . Hathaway 

Soybean Sensitivity: Case Report 

J, Mendoza^ Meyers^ R. Snyder 

Treatment of Cyanide Poisoning in Children 
C, Berlin Jr, 



The Journal of Pediatrics Valuina 77 , Number 5, November 1970 

Physician productivity and medical care 
Drachman and Cooke 

Hypoglycemie in neonata sepsis 
Yeung 

Hyperglycemia with hyperosmolar dehydration 
Stevenson and Bowyer 

Propylene glycol: Potentially toxic vehicle 
Martin and Finberg 

Boric acid ' poisoning simulating Ritter^s disease 
Rubenstein and Musher 



Obstetrics and Gynecology Yolume 36^ Number S, November 1970 



Endometrial Hyperplasia in Young Women 
Dikran Chamlian, H, Taylor 

Application of the Obstetric Forceps 
J . M i n e s 

Cervical Cytology and Sequential Birth Control Pills 
C . Dough e rty 

Central Venous Pressure in Supine Position During Normal 
Pregnancy Comparative deter minations during first, 
second and third trimesters 
R, ColditE, Josey 

Views and Reviews: Hyperthyroidism During Pregnancy 
L. Talbert, C. Thomas/ W. Holt, P. Rankin' 



American Journal of Obstetrics and Gynecology 



Volume 108, Numbers, 
November l^ 1970 



Suppurative pelvic thrombophlebitis 
C. Collins 

Obstetric and gynecologic considerations 
J. Tysonj A, Barnes, V* McKusick, C 

Renal hemodynamic effects of oxytocin in 
postpartal women 

R, Munsick, E. Gresham 

Cardiovascular effects of oxytocic drugs used post partum 
C. Hendricks, W* Brenner 

Hxperience with induction of ovulation 

S. Ma&Leon, Di Mitton, A. Parker, IV, Tupper 

Annals of Surgery Volume 172, Number 5, November 1970 

Comparative evaluation of ligation and partial interruption 
of the femoral vein in the treatment of thromboembolic 
disease 

J. Adams, J. DeWesse 

Surgical treatment of choledochal cyst 
M* Kasai, Y, Asakura^ Y. Taira 

Evaluation of a Method for Reconstruction of the 
Esophagogastric Junction and the application to Achalasia 
T. Hirashima 

Thickness^ Cross -Sectional Areas and Depth of Invasion 
in the Prognosis of Cutaneous Melnoma 
A , Bres low 

Control of Infection after Thoracic and Cardiovascular 
Surgery 

J - S . Carey 

Surgery^ Gynecology and Obstetrics Volume 131, Number 5, November 

"10 70 

Complications of Total Thyroidectomy for Carcinoma 
Norman W. Thompson and Fay K, Harness 

Surgical Management of Cutaneous Lye Burns 

G. Wolfort, T, DeMeester, N, Dnorr, and M,T, Edgerton 



of dwarfism 
Scott j G . Seegar 

ant epar t a 1 and 



Snrgery, Gynecology and Obstetrics Ccontinued) 



Roentgenographic Evaluation of Traumatic Rupture of 
the Aorta 

Marvin M. Kirsh, James D, Crane, Donald R. Kahn, 
Otto Gago, Williain Y, Moores, Helen Redman, 
Josoph F. Bookstein, and Herbert Sloan 

Total Circulating Albumin Deficits Occurring with 
Extensive Surgical Procedures 

Robert Hoye, David F. Paulson, and Alfred S, Ketch 



Appendix D 

Sample Self-Assessment 
Exam Questions , Answers 
Annotations and References 



ERLC 



Sample Sel f ^ Ass essment Ciu^^tAr^r^. 

Journal (please type) n^w Pnfti^^^ t 

^- ^ — bngland Journal of Medic-inff 

Article Title Artifiriai To^j^^ n 



Senior Author 



Lown 



I 



Publication Datfi u 



" ^'^h^^f" ??iTfi!!".i^££ ""i'iP'^ question. 

estions and 



5-70 



from the- article listed ibS^ lu s L^s anl ^n'f ^^^"^^^ generated 

the lefthand column; correct answers "nLta^^ ^^^^^^ appear in 

in the righthand column. Indicate whether ^nr^. ^^^^^ences should appear 
generalist-applicable, or applicabL trboth .r k"' Specialist ^applicable, 

^'SG- in the margin to'the 1 af t o f eL^ques t i f "'''^ ' '^'^'^ 

Boston, Mass. 02215. " question. Return to PMI, 30 The Fenway, 



f — 



Questionsi Answer Choicesi 
■ft S, G, SG Designation 



The problems associated with trans- 
venous insertion of cardiac pacemakers 
include : 

A. Higher post^op morbidity than with 
epicardial pacemakers 
Infection or phlebitis at site of 
venous entry 

Intraoperative myocardial 
infarction 

High rate of sepsis which is ini- 
proved with the use of prophylac- 
tic antibiojfics 



Correct Answers^ Annotations* 
and References 



B 



D 



Ref 



"Cardiac pacemakers in common use have 
which characteristic concerning pace- 
maker f ai lure r 

A. Pacers usually last more than 
3 years 

B. Pacemaker failure presents usually 
as musculature contraction due to 
faulty circuitry 

C. Pacemaker malfunction Is basically 
due to improper use by patients 

D. Pacer life expect ancy does not 
usually exceed 3 years 

E* A complete pacemaker history is of 
little value in diagnosis 



Intermittent pacing of a cardiac pacer 
will usually not be associated which 
^ the following: 

Presentation as an irregular heart 
rate without symptoms 
Present with symptoms of asystole 
Displacement of electrode and per- 
r^p9^"^^ation of ventricular muscle 
t fcKlv partially fractured electrode 
™™^roducing irregular pacing 



of 
A. 

C. 



Infection and phlebitis at site of 
venous entry are a major complication 
Prophylactic antibiotics are not of 
value, and the occurrence of sepsis 
is rare. Post-op morbidity is much 
less than with epicardial insertion, 
I Low^n and Kosowsky 

NEJiM 282, 1023 , 1970 

Harthorne et al Ann N.Y.Acad. Sci 

167 , 1008, 1969 



». Pacemaker life expectancy does not 

usually exceed 3 years and malfunction 
is due to component failure of changes 
within the heart. Pacer history great- 
ly facilitates diagnosis of malfunctiai. 

Ref: Lown and Kosowsky 

NEJM 283, 1023, 1970 



All of the choices are associated 
with intermittent pacing except E. 
Intermittent pacing frequently results 
from a changing myocardial threshold. 
During the immediate pos t - t r anspl an t 
period there may be an increase of ten 
times the threshold thereby exceeding 
the power output of the pacer, 
Ref: Lown and Kosowsky 

NEJM 283, 1023, 1D70 



• Sample Se l f-AssessmBnt Questions 
Journal (please type) New England Joufn.i of Medicine 
Article Title 



Reserping in thyrotoxic crisis 




Senior Author: Piiion 



Publication Date 11-5 _ jq 



In the space below please type multioip = 

from the article listed abS?!^ Ques LnJ Ld an'"'°"f ""'^ = generated 
the lefthand column; correct answers "nLtatioL and «PP^" i" 

m the righthand column. Indicate whether a ou^Jt ^^^"ences should appear 
generalist=applicable, or applicable tnhnfh ^"^^tions is specialist^applicable 
"SG" in the margin to'the ^^^^ ^^""^^ - "S". "P or 
Boston, Mass. 02215. question. Return to PMI, 30 The Fenway, 



J 



G- 



Questionsi Answer Choices • 
S S, G, SG Designation 



I 



In thyrotoxic crisis, which o£ the 
tollowing agents used alone will pro- 
vide initial effective therapy 



Correct Answers^ Annotations- 
and References 



Atropine 
Res erpine 
Tho razine 
Morphine 
AminOphyl lin 



G- 



In the treatment of thyrotoxic crisis 
with parenteral reserpine, a reduction 
m hyperthermia and tachycardia readii 
occurs. Which undesirable side effect 
might be expected 



Ref 



The use of large parenteral doses of 
resorpine, either alone or in con- 
junction with other usual modes of 
therapy has been found highly effective 
m seven patients, with thyrotoxic 
crisis. Hyperthermia, tachycardia and 
psychotic aberrations improve within 
4-8 hrs. following a dose of I-5 me 
intramuscularly and .07=. 3 mg per ke 
of body weight in the first 24 hrs 
Dillon et al NEJM 283,1020. 197o' 
Canary et al NEJM 2S 7 , 435 , 1957 



Cardiac failure 
Hypotension 
Diarrhea 
Depres s ion 
G.I. bleeding 



I I 
'w i 
ex 



n the treatment of thyrotoxic crisis 
th parenteral reserpine, a partial 
planation of the beneficial effects 
userved appears to be: 
Ganglionic blockade 

Depletion of pe riph era 1 ca t e cho 1 a- 
niine stores 

. IJapid reduction of free fatty acids 

Rapid improvement of body 

temperature 
. Increased parasympathetic discharge 

O 

ERIC 



In seven patients, treated with reserp- 
ine, diarrhea occurred in two patients, 
but cardiac failure, depression:, hypo = 
tension and G.I. bleeding was not 
observed. Others have reported the 
development of a carcinoid syndrome 
tollowing reserpine treatment of 
thyrotoxicosis. 
Ref- Dillon et al NEJM 283, 1020 1970 
■ Blumenthal et al Arch. Int. Med 
116 . 819 , 1965 



B. Reserpine an 
commonly use 
thyrotoxi cos 
cholamino s.t 
erated metab 
admini s t rati 
depletion is 
"principal e£ 

Ref; Dillon at 
Shore, Pha 



d guanethidine , the most 
d adrenergic agents in 
IS deplete peripheral cate- 
ores . The damping of accel- 
olic activity following its 
on suggests that this 

important in achieving the 
foots of reserpine. 
al NEJM £83, 1020, 1970 
rm. Rev. 14, 531, 1962 



S a m p le Self-Assessment Qum^tj 



ons 



Journal .(please type). New England .Tnn.n.i M^djcj^^ 
Article Title Psychiatrie Compl: 



Ications of Open-Heart Surgery 



I — — 

} Senior Author: 



Heller 



Publication Date 11-5^70 



In the space below please type multiple choice au^^fi^ 

from the article listed ab^ QueitLns and ^^t u answers generated 

Boston, Mass. 02215. question. Return to PMI , 30 The Fenway, 



Questions; Answer Choices; 
6 S, SG Designation 



In patients expeTiencing a syndrome 
Df post-^cardiotomy delerium, the most 
Lmportant operative factor related to 
a decline in this syndrome since 1965 
wou 1 d b e : . 

Use of hypothermia 
B* Use of newer drugs 
C* Shorter duration of 
recovery room 
Improved prosthetic 



Correct Answers | Annotations* 
and References 



time in the 



valves 



Length of time on cardiac bypass 



Preoperative factors likely to pre^ 
dispose to the development' of post- 
operative delerium include: 
Sex of patient 

Use of tranquilizers pre-op. 
C . Age of patient 

Days in hospital before surgery 
Abnormal psychiatric evaluation 
before surgery 



Although many factors contribute to 
the likelihood of developing delerium 
It has been shown that the reduction 
m bypass time is probably the most 
important single factor responsible 
for the diminished prevalence of 
del e rium * 

Ref: Heller et al NEJM 243^ 1015, 1970 

Egerton and Kay, Brit. J. Psyc IIQ 
433/ 1964 ' ■ * 



The development of an organic brain 
syndrome following open-heart surgery 
IS most likely related to: 

Use of a disk oxygenator during op 
Length of time on cardiac bypass 
C , Sox 

Structure of open-heart 
room 

Replacement of mitral valve 



r e c o V e ry 



Of these factors, the age of the 
patients appears to be the only one 
with a positive association with devel- 
opment of post-cardiotoiTiv delerium. The 
mean age of patients developing 
delerium is significantly greater than 
the age of patients who do not develop 
this syndrome . 
Refi Heller et al NEJM 283, 1015, 1970 



A, The use of a disk oxygenator has been 
shown to be significantly associated 
with the development of an early post- 
op organic brain syndrome. The other 
factors do. not appear to have any 
definite correlation with the develop- 
ment of this syndrome. 
Ref: Holler et al NEJM 283, 1015 1970 



1 



! 

Sample S elf-Assessment Questions 
j Journal, (please type) New England Jou.n^i pf Medicin. 



Artdcle Title 



Home Transfusion far Patiants wjt jLjje.oph i 1 i a A 



Senior Author- Rabiner 



In the space below please 
from the article listed above 
the lefthand column; correct 
in the righthand column, 
generalist-applicable, or 
"SG" in the margin to the 
Boston, Mass. 02215. 



Publication Date ll-S 



70 



e mi 



lultiple choice questions and answers generated 
Questions and answer choices should Ippear in ^ 
ind?"'r",' references should appear 

Indicate whether a questions is speci a 1 i s t ^ app 1 i cab L 
applicabJe to both groups by putting a.-S". "P or ' 
left o± each question. Return to PMl . 30 The FeLay 



Questions- Answer Choices 
5 S, G, SG Designation 

The major complication arising from 
attempts to set up a home transfusion 
service by family members for adminis^ 
tration of cryoprecipitate to patients 
with hemophilia might include: 



1. 



Anaphylaxsis 

Mild sllergic reactions such as 
hives 

Severe infections due to lack of a 

aseptic technique 

Use of excessive quantities of 

cryoprecipitate 

Delay in treatment of minor hemor- 
rhages 



Joint Hemorrhage 
Soft tissue hemorrhage 
G. I, hemorrhage 
Prophylaxsis before tooth 
Nose bleeds 



Correct Answersi Annotations*, 
and References 



^"^'^ ^ program in which 
relatives of hemophiliac patients were 
trained to administer transfusions 
IS months experience disclosed that 
the only complication was mild 
reactions , 
Ref: Rabiner at al NEJM 283, 1011 



a 1 1 e r g iq 
1970 




extraction 



SG- An immediate 
usion program 
ationts might 
A, 



gain of a 
for adult 
be : 

of a crippling 



home tranS' 
hemophilia 



Ref 



Joint hemorrhage is by far the most 
common bleeding problem in adult hemo- 
philiacs and represents the highest 
consumption of cryoprecipitate bv 
adult hemophiliacs in a home trans- 
fusion program. 

; Rabiner ot al 283, 1011, 1970 



arthropa- 



Prevention 
t'hy 

Decrease in number of . days absent 
from school or work due to bleeding 
Decrease in amount of cryoprccipi 
tate consumed 

Decrease in amount of analgesics 
consumed 

Decrease in number of hemorrhages 



B. A. report of an 18 month home trans- 
fusion sQTvice showed that the number 
of .days lost from work or school was 
significantly reduced among patients 
receiving transfusions at home but 
there was no significant change in 
other parameters, except for an in- 
crease in conauniption of cryoprecipi- 
tate among patients receiving home 
transfusion. 

Ref: ot al NEJM 2S3, 1011 1970 



ERIC 



Sample Sel f -Assessment Questions 
New England Journal of Mflrlirin^ 
Necrot izinp angiitis. assoeiat.H drug .h.... 



Senior Author: citron 



Publication Date 11.5,70 
In the space below please type multiple choice niiPei.i„„= , j 

from the article listed aboTeT Questions and answeJ Sn? ^^^'f' 8°"«'"ed 
the lefthand column- correct answers, annotations and r.f"' "^^^^^ ^" 

in the righthand column. Indi cate whetJefrquestlon/i. " , "P?^" 

Boston! MaL^"i221S? '''' °' '''' = - ^Ml, 3o'The PeLay, 



^1 



Questions* Answer Choices; 
5 G, SG Designation 


Correct Answers^ Annotations* 
and Kererences 


The parenteral injection of which of 
the following drugs is most likely to 
be associated with a syndrome of necro 
tizing angiitis in drug abusers • 

A, Marijuana 

B , Ritalin 

C , Methamphetamine 

D, Methadone 

E, Coccaine 


C. In fourteen young drug abusers with 
necrotiaing angiitis, all but two had 
used parenteral methnmphetamlne ■ 
This was used alone or in combination 
with heroin or d-lysergic acid 
Ref; Citron et al NEJM 283. 1003, 1970 
^eeK htdM Z4 8 . 76 4. 19S3 


- In a syndrome of necrotizing angiitis 
associated with parenteral drug abuse 
the diseased blood vessals most re- 
semble the classic picture o£: 

A, Hypersensitivity angiitis 

B. Periarteritis nodosa 
Penicillin allergy 
Serum sickness vasculitis 
Vasculitis associated with lupus 
erythematosis 


B. The necrotizing angiitis associated 
with drug abuse is remarkably similar 
to periartitis nodosa with severe 
renal, c ardi ac , ■ neuro logi c and gastro- 
intestinal involvement. The histologic 
picture did not resemble hypersensitiv- 
ity angiitis in which small arteries 
vonules and capillaries are involved. 

Kef: Citron ot al NEJM 283, 1003, 1970 
Zeek 24_8, 764, 1953 " 


In necrotizing angiitis associated 
with drug abuse, the most useful 
historical information or procedure 
in making the diagnosis would be: 
A. History of hypertension 
B* History of asthma 

C, Renal and visceral angiography 

D, Careful op tha Imos copi c exam. 


D. The most crucial tost in making the 
diagnosis is angiography. No patiei.- 
had a history of asthma or noteworthy 
allergy. Hypertension and hemolytic 
anemia developed in only an Isolated 
patient, 

Ref: Citron et al NEJM 2BI, 1003, 1970 
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Sample Sel f ^Assessment Questions 

Journal (please type) American Family PhyGician/GP 

Article Title An^losing Spondylitis 



Senior Author: Drs. Oalabro, Maltg and Sussman 



Publication Date II/70 



generaust-appucaua. or applicaMo Jo^'«h%?o^ s'\^"%;?tiSr"'s"""?S"r" 

margin to the left of oach question. Return ^ ' ^ ^" 



'*SG'» in the 



Boston, Mass. 02215 



to PMl , 30 The Fenway, 



Questions* Answer Choicesi 
5 S, G> SG Daslgnation 



A 30 year old man presents in your office 
with an intarmittent low back pain of 
several years duration. Which of the 
follov/ing would be the most helpful in 
your physical evaluation? 

A) A full hiatory and physioal evalua- 
tion including careful examination 
of the back, 

B) Contacting his previous physician 
to datermine whether this man was 
just a chronic complainer, - 

C) Careful attention to past history 
to determine whether he had had 
multiple back injuries in school- 
boy Bports. 

D) A positive family history of 
arthritis. ^ 



2* Which of the following laboratory tests 
would be most helpful in diagnosing AS? 

A) An SMA - 12 profile. 

B) Erythrocyte sedimentation rate. 
G) a blood test for rheumatoid factor. 
D) An anti^streptolysin titre. 

3. Vfhich of the following clinical signs 
would be most helpful in diagnosing AS? 

A) Straight leg raising. 

B) A Sohober test. 

C) Patrick's sign, 

D) Brudginaki test. 



A. The drug^ihoice for a patient with early 
mild AS would bei 

pn^/^-O Phenylbutazone. 
L^^i) Indomethacin. 
Q)' ABpirin* 

T\ \ f\ I. - 



Correct Answers^ Annotations-, 
and References 



This disease occurs most frequently in 
young men between I5 and 35 years of ago 
and has characteristic symptoms. One can 
frequently make the diagnosis from the 
history and by performing a number of 
clinical tests. 



B The erythrocyte sedimentation rate is 
elevated in a majority of patients with 
active dir.ease but is normal in 20^. 
Rheumatoid factor is rarely present. 



3, B 



4* C 



This test is positive in early lumbar 
involvement. Straight leg raising and 
flrudsinski tests are usually normal. 
Patrick^e eign is indioative of disease 
usually in the sacroiliac jointB and im 
therefore not too helpful. 

Aspirin IB the drugAChoiaci»*presaribed in 
daily amount of ^-6 gra-ny, Indomethaoih 
and Phenylbutazone are aloo very effective 
but Ehould not be usod m a first line drug 
bocause of their Kicle^effects. Adreno- 



Sample Self-Assessment Quest ions 
Journal fplease typoj American F'amily Ph.ysioian/np 



Artxclo Title 



Practical TherapeuticB , -n..^..^. "n naffement of F lu 



Senior Author:^ p^. Mary M. narrutH^r. Publication Date 



JJilO. 



In the space .below please type multiole ch oi ce nn^ c ■»= 4 , j 

fro. the article U.tod abSvf- Quostioni „d ns, °ch» "'/"houH f"""^" 
the iofthanJ colun,,,; correct answers, annotations ajd reforencL JhoMff" 
in the righthand column. Indicate whether a au"st?on/ir! ■ , 

^sG"'ii'?,'-T''""°' r " s bTp t n^rr-s^-'-^E'^r'"' 



Quebtions^ Answer Choices; 
5 SG Designation 



I Secondary bacterial pneumonia is the most 
Cj frequent pulmonary CQmplication of flu, 
Vlhich of the followinf^ org-anismB is most 
often responsible? 

i V 

! A) Staphylococcous aureus. 
B) BiploQQcCQus pneumoniae, 

j C) Hemophilus influenzae, 

I 

2, Pneumonia may occur eynchronously with 
3'* othar symptoms of flu. This is seen 
I primarily in what froup of patiento? 

A) Patients with Rheumatic Heart Disease. 
r B) Patients with Chronic Obstructive Luni; 
I Disease, 

^ C) Patients who are prone to status 
asthmaticus* 

j 

^ 5* Which one of tho following is recommended 
I" by the U*S» Public Health Service? 

! A) Intradermal adminiBtration of Influenza 
Vaccine* 

fl) Anti-viral Qhemotherapy with Amantadine 
f C) Two doses of vaccine adrtiiniBtered uub- 
\ cutaneouely 6«8 weeko apart* 



Correct Answers,^ Annotations* 

and References 



1. 3 



DiplococGous pneumoniae although 
Staphylococcous aureus is found in about 
25;^ of the cases and Hemophilus influenzae 
IE only occasionally the casual apent in 
patients with chronic lung disease. 



2. A Patientc with nheumatic Heart Disease - 
particularly Mitral Stenosis. 



3, C This has been proven the most efficacious 
and yet the duration of immunity is only 
BIX months. However , the le%^ol of immunity 
IS higher . than with intradermal vaccine, . 
Amantadine is still in the investigational 
stare. 



ERIC 



Sample Sel f -Assessment Questions 



.Journal (please type) American Family Physician/CP 
Artj.c]e Title Mana|gament of Respiratory_ Failure 



Senior Author: jy, j phn A. Kibelstis Publication Date 11/70 



In the space below please ty^e multiple choice questions and answers generated 
fhri'5?."f Q"«stlons and answer choices should f^pear in 
the lefthand column; correct answers, annotations and references should appear 
in the righthand column. Indicate whether a questions is speciali,t=app "able 
generalist = applicable. or applicable to both groups by putting a -S'- Wlr ' 
Bo ton" M^n^lT '''' °' question. Return to PMI, 30 'the Fenway, 



Questions; Answer Choices; 
G S, SG Designation 



Correct Answers^ Annotations* 
and References 



1 , A 65 year old ehroniG lunger ie admitted 1 
to the Coronary Care Unit because of an 
Acute Fflyocardial Infarction, He is given 
Morphia for his chest pain, oxygen for hi^ 
anoxia, Seconal for sleep and Phenobarbital 
4id for appreheneion. On the third day 
he wao found to have a PaCOg Of 60 mm.Hg 
and a PaOg of 50. Which of'the following 
would be moEt appropriate in his manafTement? 

A) Increase his oxygen intake by mask, 

B) DiBcontinue both the daytime and bed- 
time sedation* 

C) Give him intermittent positive pressure 
breathing (IPPB) with oxygen, 

J) Put him on a bronchodilator. 



Yq^^MTb carinf for a patient in the ICU who 
has-^an endotracheal tube. In the same room 
with your patient is a surgical patient who 
has just been brought back from the operat- 
ing room with a ruptured eangrenous appendi 
citis* What is the 'best plan for managing 
your patient? 

a) Insist that the surgical patient be 
moved out of the room, 

B) Insist that strict sterile technique in 
the pulmonary toilet be adhered to, 

C) Put your patient on prophylactic anti^ 
biotics * 

D) Have a tracheostomy performed on your 
patient. 



B Overuse of sedation is a frequent causo of 
respiratozy failure in the hospital. Not ^ 
only should his barbiturates be discontinued 
but also the Morphine. In addition, the over=. 
use of dxygen md intermittent positive 
pressure brer^^ing can be factors in respira= 
tory failure in a previously compensated 
patient with chronic obstructive lun^: disease. 



2, 



B Sterile technique must be observed when endo- 
tracheal suction is beinp used and in addition 
the ventilator delivery tubing m.ust be changed 
at least once daily. While exposure of your ' 
patient to an infected surgical patient is 
not desirable it is not imperative that he 
be moved out of the ICU, 



1 Sample Self-Assessment Questions 

, Journal (please type) American Family Ph ysician/GP 

{ ~^ ~ ' — '■ — — — = — — 

■ A r t i c Title 



Management of Respiratory Failure 



Senior Author: 



Dr. John A. Kibtlst i b 



Publication Date 1 1 /70 



In the space below please tyjoe multiple choice questions and answer, cone-ated 
t^r,'^:."f ? Questions and answer choices should applir in 

the icfthand column; correct answers, annotations and references should appear 
m the righthand coluinn. Indicate whether a questions is s pec i al i s t -aDD 1 i cab 1 ^ 
general. st-appUcable, or applicable to both groups by putting a 's' "gf^'^r 
Bostoi? 'nL'!"i221s! °' question. Return to PMI, 30>he Fenw.y, 



Questions; Answer Choices; 
6 G, SG Designation 



3. In a narcotized apneic patient requiring 
' immediate intubation and controlled 

ventilation whioh of the following pieces 
of apparatus would be most appropriate? 

A) A pressure-cycled ventilator. 
An Emerson respirator, 
A volume--Gycled reepirator, 
A self inflating hand resusQitator, 



Correct Answersj Annotations* 
and References 



I) 

c) 



ERIC 



3. C A pressure^cycled ventilator is far less 
desirable because tidal volume and oxygen 
concentration vary oonsiderably with the 
level of air way resistance. An Einerson 
respirator and a hand resuecitator would 
be of no value whatsoever. 



Sample Self -Assessment Quosti ons 



] Journal (please type) American Family Physieian/GP 
Article Title Care of Common Foot ProblemR 



Senior Author: Dr« Ren e Cail liet 



Pub lie at ion Date 



11 /7Q 



In the space below please type jnultiple choice questions and answers generated 
from the article listed above.: Questions and answer choices should appear in 
the lofthand column; correct answers, annotations and references should appear 
in the righthand column. Indicate whether a questions is specialist-Lppiicab le, 
generalist-applicable , or applicable to both groups by putting a -*S**, *'G'' or 
''SG" in the margin to the left of each question. Return to PMI , 30 The Fenway 
Boston, Mass. 02215. 



Questions^ Answer ChoiceSj 
5 S, G, SG Designation 



^ 1 , B At the end of the day ^ vrhen standing and 
walking have sliphtly broadened the foot 
and lengthened the longitudinal arch. 



Correct Answers; Annotations* 
and References 



1 * Fitting of shoes is ideally done under whic 
one of the following conditions? 

a) Early in the morning before the foot 

has a chance to swell. 
B) At the end of the day. 
G) It really doesn't make any difference* 

2* Heel spurs are most commonly caused by one 
* of the following conditions, 

a) Walking with a foreign body such as a 
Btone or a raised area in the heel of 
the shoe, 

B) Excessive walking on cement floors, 

C) The direct result of shoe pressure 
aggravated by marked v/eight gain and 
excessive walking after prolonged re-. 
cumbency* 

3. The condition known as Hallus Rigidus is 
caused by one of the fQllowing conditions, 

a) Gout, 

B) Osteoarthritis, 

0) Rheumatoid arthritis* 

D) A sesamoid bone overlying the joint, 

4* Pronation and Pes Planus is a common proble 
in children. This is best treated by which 
of the following? 

a) Metatarsal pads, 

B) A metatarsal bar* 

C) A Thomas heel with a medial heel wedge, 

ERJC 



There is no data to indicate that a 
foreign body will cause any condition 
except a local skin irritation* 



B Gout and rheumatoid arthritis may be a 
cause of pain in the great toe joint but 
it is degenerative arthritis which causes 
the symptDm* Sesamoid bones are frequently 
seen by x-ray and rarely cause symptoms. 



4* C A Thomas heel will supinate the foot and 

cause slight inversion and the added wedge 
medially shifts weight bearing to the 
outer aspect of the foot. 



Sample Self ^Assessnient Questi 



ons 



Journal -Mease type)_ American Family Ph ysician/QP 



Senior Author; 



ilU^rrRt.t, Tr , Pnl ^ ttc;^ mh Publication Date 



In the space below please type multiple choice auestinn= 

fr« the article listed ab^Tt" Questions and ans»e"choices°^houTH 

the lefthand column; correct ansKcrs annotatinn! ! j J should appear in 

in the righth.nd column ! Indicate"hetherr"L% o /L"°"cf:, '''r" f""" 

Seneralist-appUcable, or applicabie to both e^o^ps bv^pi t n'^ "S" "c^i^ ^r''^' 

Bo'sto Ma s""?2"l ° ' = °' " = " = - o'The Fe"wa,, 



Questions' Answer Choices; 
5 S, G, SG Designation 



Correct Answers| Annotations', 
and References 



1, Which of the following Ghanges in the 
peripharal blood is not suggestive for 
ma 1 i gnan cy? 

A) The presfnce of nucleated red blood 
oelle, 

B) Increasa in target cills. 

C) Moderate decrease in total platelet 
count , 

D) The occurrence of schist Qcyt es , 

3, "Helmet celle" are occasionally seen in 
the peripheral blood in all but one of the 
following conditional 

A) Thrombotic Thrombocytopenic Purpura 
(TTP). 

B) Malignant HypertenBion. 

C) Uremia. 

D) Myasthenia Gravis, 



The presence of nucleated red blood cells 3. d 
in peripheral blood is not a general find» 
ing in which one of the following condition^? 

A) The patient with massive acute hemorrhake, 

B) Hemolytic Anemia, 

C) Myelofibrosis, 

D) The normal adult. 



C Actually, there is frequently an apparent 
increase in the platelet count (thrombo^ 
cytosis) in patients with malipnant disease. 



2. D In Myasthenia Gravis there is no hemolyaiB^ 
as there is in the first three conditions. 



The presence of nucleated red blood cells in 
the peripheral blood^ reflects marked 
acceleration of normal erythropoiesiB and 
one can readily find these cells in the 
first three conditions. 



Sainple Sel f ^Assessment Questions 
Journal fplsase tyDel * ^ ^ 



Article Title Rubella Vir us Vaccine - Recominendation of the Adv:.sQry Committe e on 
_ Inununization Practices, U.S, Public Health Service 

Senior Author: 



Publication Dat^QV^, 1970 



In tho space below please type multiple choice aup^tinne ^^a 

from the article listed .b^T Quastions and answar cho^es'shoulH 

tha lofthand column, correct answers, ^nnotatio^Zd ltftlln^rlL^r''' 

m the nghthand column. Indicate whether a question. , 

gonaralist^appucabla. or . app 11 cab 1 e t o b S^h ^Jou "rpu ti^f^-S ^ 



Questions* Answer Choices; 
S SG Designation 



Correct Answers^ Annotations* 
and Rererences 



Live, attenuated rubella virus vaccine 
should be administered to: 

f A, Adolescent and adult women in a routine 
! fashion. 

Pregnant women. 
Six month old infants. 
Boys and girls between 1 year old and 
puberty* 



y CG,S3 

2, All of the following statements about the 
^-;ubella virus vaccine are correct except: 
I A. 95% of susceptible vaccinees will develop 

antibodies* 
B. Use of tha vaccine in children whose 
j mothers are pregnant is contraindicated. 

? C, It should not be used in patients with 
leukemia, 

f D, A history of rubella illness is not 
1 reliable enough to exclude children 

from immunization, 

i 

I \ 

^ (G,S) 

3. (T,F) The great efficacy of the rubella 
^^irus vaccines is not due to its ability to 

rovoke antibody levels in excess of those 
found after natural rubella infection. 



1* D - The vaccine should not be administered 
to women routinely because some of tl.em may be 
pregnmt and not know it. Administration of the 
vaccine to infants under one year of age should 
not be done because of possible interference 
from persisting maternal rubella antibody. 
Annals of Internal Medicine 



2. 3 - Although vaccinees may shed small amounts 
of virus from the pharynx between the first and 
fourth weeks after inoculation, the probability 
of spreading the virus is actually very low. 
Annals of Internal Medicine 



3, True - Antibody titers to the rubella vaccine 
are actually lower than those observed after 
natural rubella infection. 
Annals of Intemal Medicine 
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Sample Se 1 f ^ As s es smon t Questions 

p Journal Cplease type) a i ^ t 

: ■ -rP^J^ Annfli^ pf Tni^p^^^ M edicine 

Article Title 



-R^f-PTif A dVRnr^^ in Tmmnnj -j py^ Arninst Viral Di.gf^ag 



Senior Author: Stokes, Joseph 



Nov. 

Publication Date 1970 



fJo:'':^!'':"!'!^™^':^:^^ ""I^lilll.^^i^ -""^ generated " 

in the righthand column, Indicate wlotjer a oucLioJ/ "'", *PP"' 

803,0^: MaL"1^5.r " = ^ «^'-n LV,,^ P^La,, 



Questions,* Answer Choices; 
5 S, SG Designation 



CS) 



I • Life-long persistence o£ antibody in huinans 
to attenuated vaccines have been demonstrated 
;^or all of the following except: 
j A, Smallpox 

B, Measles 

C. Rubella 
: Mumps 



f'. (T^F) The measles attenuated vaccine has 
} een of only modest benefit to mankind because 
^of distribution problems* 

CT,F) Utilization of mumps vaccine may 
,prevent the childhood form of illness, leaving 
j he child susceptible to the more severe 
^' ariety when he becomes an adult* 



Correct Answers; Annotations* 



and Re f erences 



1. A - The appearance of persisting protective 
antibody in B,C, and D consistently follows 
administration of the appropriate attenuated 
vaccines . 
Stokes et al 



2, _ False - In West Africa, where measles has a 
25% mortality rate, it has been estimated that 
at least 600,000 to 700,000 children owe their 
lives to the attenuated vaccine* ^ 

Stokes et al 

3. False - Recent evidence indicates that 
antibody to mumps attenuated vaccine maintains 
a permanent alert. 

Stokes et al 



Sample Self-Assessnient Questions 

Journal (please type) Annals of Internal Medicine 

Article Title 



Lne Isethlonate in the Treatment of Pneumocystis Carinii 



Senior Author: Western^ Kar 3, A. Vol 73, No 5 



Publication DateiNQV., 1970 



In the space below please type multiple choice questions and answers generated 
from the article listed above. Questions and answer choices should appear in 
the lefthand column; correct answers, annotations and references should appear 
in the righthand column. Indicate whether a questions is s pec i al is t -appl i cab 1 e , 
generalist-applicable , or applicable to both groups by putting a "S", "G" or 
-*SG'' in the margin to the left of each question. Return to PMI 
Boston, Mass. 02215. 



30 The Fenway^ 



Questions J Answer Choices] 
5 Si SG Designation 



rSG 

1 1, (T-Fj It is known that Pneumocystis Carinip. 
pneumonia may complicate neoplastic and immun^ 
ologic disorders • However, the presence o£ 

f P. carinii should be suspected whenever a 
pneumonia does not respond optimally to treat- 
ment even in the absence of a serious under ^ 

j lying disease, 

SG - 

l\ CT-F) Azotemia or abnormal liver function 
1 ests occurring after the onset of Pentamidine 
therapy for P, carinii pneumonia are signals 
,^or the permanent cessation of such treatment 
! ecause of the high Incidence of ^^reversible 
Lepatic»or renal toxicity with this drug, 

( 



I /. (T-F) Pentamidine is the most effective 
"treatment for Pneumocystis carinii pneumonia j 
.^ut histologic confirmation of the diagnosis 
j biopsy, aspiration^ respiratory material) 
^y-hould precede therapy because of the signifi- 
cant toxic reactions to the drug* 



Correct Answers^ Annotations*, 
and References 



1p False - Virtually every patient with 
documented P* carinii pneumonia reported by 
Western 3 et al suffered from some underlying 
disease such as acute lymphocytic leukemia^ 
Hodgkin disease, th>Tnic alymphoplasiAj or had 
undergone organ transplantation* 
(Western et al) 



2, False - Manifestations of renal and hepatic 
toxicity occur commonly during Pentamidine ther- 
apy and may require temporary discontinuation 
o£ treatment. Reins titution of Pentamidine 
injections, however, may well be justified 
when parameters of organ disfunction return 
to near normal and evidence of continuing P. 
carinii infection is present, 
(Western et al) 



3. True - Pentamidine isethionate is the drug 
of choice for P* carinii pneumonia* In most 
patients receiving the recommended nine doses, 
P. carinii was eliminated from the lungs* 
(Western et al) 



I 



Sample Self-Assessment Questions 
I Journal (please type} Annal. nf TnnanakMed icine 
Article Title 



Xentrilohular Hfip Btir N^r-^ne-;. nnH Acute Renal Failure in "Solvent Sniffers" 



Senior Author: Baerg, Richard D. 



Publication Date Nov.. 1970 



In the space below please type multiple choice nuesfinT,= 

from the article listed abF?^ Oueftion, ^nd answers generated 

tho lofthand column; correL answer anLtati ^PP^" 
in the righthand colu.n. Indict "heth f ^e .^'/ts"'" 
goneralist^appllcable, or applicable to b:th%?ou;rbrp ,i^r""""^If^'or 
B to M ss^^ia^ir '''' °' '''' to ImI. 30'Th P nway. 



Questions^ Answer Choices] 
§ S, G, SG Designation 



Trichloroethylene induced hepatic damage 
differs from viral hepatitis in all of th© 
V following ways except: 

I A. TTiere is a history of -^solvent sniffing^* 
Onset of syinptoms is rapid. 
Hepatitis-induced antigen is absent. 
Hepatic damage is more severe and lasts 
longer. 



B. 



2a All of the following are manifestations 
J of acute trichjoroethylene toxicity except: 
I A, Depressed level of consciousness 
B* Cardiac arrhythmias 

. C. Increased lacrimation 
I D, Hepatic injury 



3. CT,F} '^Glue sniffers" suffering from 
trichloroethylene toxicity should be treated 
•/ith intravanous ethanol which promotes ex- 
cretion o£ the toxic metabolites. 



Correct Answers^ Annotations 
and References 



1* D -Hepatic injury dye to trichloroethylene 
inhalation is unusual^ mild, and transient in 
most cases* 
Baerg et al 



2, C - Chronic intoxication in metal degreasers 
is more apt to produce increased lacriniation, 
reddening of the skin, insomnia in addition to 
tremors, giddiness and anxiety, 
Baerg et al 



3. False - Hepatic damage in trichloroethylene 
toxicity is potentiated by ethanol. 
Baerg et al 
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( Journal (please type) 



Sample Sel f ^Assessment Qu esti 



□ ns 



Article Title 



Pnthn p h yM mng y n n r l Th nrnry nf thA ^^^n], gf Nfynr^r^ial Infarction 



Senior Author i^^ddv. Fr.nH . .T, 



Publication DateNov., 1970 



In the space below please type multiple choice aue^^t^nr.^ . a 



gon.ralist-appucable. or applicable ^l^ll, ^ZIV 1^%^^ tl^ ^ 

oG in the margin tn t^he ^«^u _ ^ui^uiii^ a 



|'SG»* in the margin to the left of each'qGes ti on' 
Boston, Mass. 02215, 



Or 



Return to PMI , 30 The Fenway, 



Questions* Answer Choices] 
6 S, G, SG Designation 



CS.G) 



C. 
D. 



, A 45 year old man is admitted with findings 
consistent with an acute anterior myocardial 
infarction and cardiogenic shock. Which one 
Lf the following is not a reason to insert a 
^entral venous catheter? 

A* For phlebotomy in case pulmonary edema 
develops* 

For insertion for Intracardiac pacing 
elactrodes* 

For rapid infusion of IV fluids* 
For rapid infusion of mercurial diuretic 
and aminophyllintfi 

For measurement of changes In intra- 
thoracic pressure and ventilatory 
distress. 



2. From experimental studies, which of the 
following pharmacologic agents is least 
likely to benefit the patient in cardioffenlc 
shock? 

A. Isoproterenol 
Levarterenol 
Digitalis 
D. Dopamine 
Glucagon 



Correct Answers^ Annotations* 
and References 



1. D - Rapid intravenous infusion of mercurials 
and aminophyllin#may result in life threatening 
arrhythmias. A,B,C m are solid reasons for " 
inserting the central venous catheter. 
Hurst i Logue, The Heart, McGraw-^Hill 1970 
pp 1570-1572 
Haddy et al 



2, A - Although isoproterenol provides an 
initial rise in cardiac output, accelerated 
deterioration is likely to develop. Greater 
myocardial oxygen utilization is not met by a 
sufficiently large. increase in coronary flow. 
Haddy et al. 



• " , ■ Sample Sal f -Ass essment Questions 

Journal (please type) Annala nf Tnt^m^i Medicine 
Article Title 



PathOPhysiQlogy and Therapy of the Shock of Myocardial Infarction 



Senior Author 



Publication Date Nov.. 1970 



In the space below please ty£e multiple choice questions and answers generated 
1 '''''' answer choices shouH fppear in 

the lefthand column- correct answers, annotations and references shouid appear 
m the righthand column. Indicate whether a questions is sped al i s t -aDDli cab 1p 
generalist-applicable, or applicable to both groups by putting a ''s' 'P Jr 

Bfatoi" ^ass'"!2215: '''' °' '''' - So'lhe Fenway. 



Questionsi Answer ChQlces; 
5 SG Designation 



] CS,G) 

3, The following is a true statement regard- 
j Lng cardiogenic shock In man: 
i/u The mortality o£ patients in cardiogenic 

shock after an acute myocardial infarction is 
4 ibout 50%. 

] The Introduction of coronary care units 
has reduced mortality of the patients with 

.^^cute MI and pure ^^pump failure^*, 

I Cardiac output is diminished and peripheral 

li^asoconstrictlon is uniformly present. 
D. Transmural infarction and coronary thrombos 

J ire found in the majority of patients dying 

i Ln^ cardiogenic shock. 



Correct Answersi Annotations* 
and References 



3, D - However I the role of coronary thrombosis 
in the pathogenesis of the infarct is presently 
a controversial topic. 
Haddy et al 



IS 



1 
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Sample Se 1 f ^ Ass essment Questi 
Journal (please type) ThR An^fn^an ^n^^m^^^ttdlMnft^ 
Article Title KyqrPI F>^-TTir1nn^r1 S-T ffl avatlon 



ons 



Senior Author: Bt. Nicholas J,, Fn.-h,H. 



_Publication Date Oct. , 1970 



In the space below please type multiple choice n,,^^^^ 

from the article listed ab3#r Que? Lns and \' generated 

Boston, Mass. 0221S, " question. Return to PMI , 30 The Fenway, 



Questions* Answer Choicesi 
Ef S, G, SG DesignatiDn 



i Ihe ocmirence of 1 mn flat or up^eloplng 
S-T eegment elevation during or" shortly 
rafter ©xerGiae is nioet litely dus to: 

a) The nomri EKO chaiifee ?/hiQh aOQoiffpaiiy 
.^elnus tachycardia, 

■fa) The onset of an aeuta i^cardial inf arotior] 

c) The manlflstatlon of severe, but 
reversable norocardial Ischemia. 

S (inteTOlet) 



Correct Answers? Annotations- 
and References 



Answer: c 

S-T sagment elevation assoolated with exercise 
IS a sign of severe n^jraoardial Ischemia, mese 
patients have an occluded or nearly occluded 
major coronaiT- vessel hy coronary angiography 
They also have a high Ineldence of sudden 
death, mtir EKG changes are reversahle f ol- 
loTrtng osssation of exerciee, and do not 
necessarily mean acute infarctions. Sinus 
tacl^cardla may produce S-T depression but 
not elevation in a person with a normal heart. 



Pet: ilror. J. of Msd, 49:459-70 



X " ^ l> .1. U I u 



Journal (please type) 



Thft ArT^riffln .Tdurnal of Madlntn^ 



Article Title Exercise-Inducad S-T Segmnt Elevatinn 



_Dr. NlcholaB J. Fortuin 



Publication Date Oct. , 1970 



Senior Author 

In the space below please type multiple choice auestinn* ~ 
from the article listed abH?iT Questions and 2.!! \ answers generated 

the lefthand column; correct answer "^L^ati^nfaLlafe" 

xn the righthand column. Indicate whether a an^^. references should appear 
generalist-applicable. or applicable to bo^h.?" ^' " = ia 1 i s t -appl i cab 1 e 
^SG m tha margin to the left of each question ^ ^ putting a S , "G*^ or 
Boston, Mass. 0221S, 



Return to PMl, 30 The Fenway, 



Questionsi Answer Choices; 
S S, G, SG Designation 



WMle performing a Maeters two-step test; 
a 60-3^ar old man had to stop because 
of ehsat pain. EKG on© mnute following 
exercise revealed S-T segTOnt slevatlon in 
leado AVL^ Vg and ?g/ ^ese chaises 
and the pain subsided over the subsequent 
10 minutes. Hiese findings are most 
consistent mth: 

a) A poor prognosis because of the Mgh 
Incldenee of BUdden death, 

b) A high-grade coronaiy obstruction near 
Its origin* 

c) Both of the above, a and b, 

d) Neither a nor b. 



Correct Answers j Annotations: 
and References 



AnOTeri b ^ . 

S-T elevation during or f ollov/ing exercise 
does not mean acute nyocardial infarction 
if it Bubsldes qulciay. It is^ however^ an 
ominous finding because of the high Incidence 
of sudden death and Mgh grade of coronary 
obstruction near the origin of a coronary. 



mi 



Amer, J, of Med, 49:459:70 



Samplo ScIf^AssossniGnt Quostions 
Journal (please type) Amerloan Joinmal of KfeaiGine 
Article Title H:vpertenglon and the Lupug Svndrore 



Senior Author 



Publication Date 



Oct., 1Q7Q 



In the 
from th 
the lof 
in the 
general 
^'SG'^ in 
Boston , 



spaco balots^ please type multiple choice questions and answers generated 
e article listed above" Questions and answer choices should appear in 
thand column; corroct answers, annotations and references should appear 
righthand column. Indicate whether a questions is speci a 1 is t - app l i cab le 
ist-applicable ^ or applicable to both groups by put ting ^ a- ''S'* , '*G" or 
the margin to the left of each question. Return to PMl, 30*The Fenwav 
Mass . 02215, / - ' 



Questions J Answer Choices; 
6 S, G, SG Designation 



Correct Answers | Annotations- 
and References 



Drugs whieh have been found to produoe a 
' It^s-lllgs eyndrom ^are: 

^ a) Hydralazine 

b) Procaine Amde 

c) DlphenylhydgntQln 

d) Isonlazld 

e) All the above* 



Answer* e 




All the above drugs have been Ij^licated In 
causing the drug-lndueed lupus-like syndroinfi, 

Ref , I AinQr. J, of Med / 49 ■ 514 ■ 70 



ERIC 



1' 



Journal (please type) 



The AnmTjQ^ jQiiw>ai ^^^^ 



Article Title 



cine 



a?PfrtanRton and t.h^ Lupus R^pia^rr^ 



Senior Author: 




Publication Data Oct,, 1970 



the lefthand column- correct answers ! answer choices should appear in 

in the righthand coluan^ IndieaL whether "fiances should appear 

SG m the margin to the left of each aue^t< f ^ putting a "S", "G" or 

Boston, Mass. 0221S. "'^ question. Return to PMI , 30 The PeLay. 



Questions I Answer Choices 
6 S, G, SG Designation 



A flf ty-3rear old white male was begun on 
Wralazine ma methyldopa beeause of blood 
PMSSUTO loadings of I8O/130 on three 
separate oceaslons. One inonth later, 
when Ms pressurt was under good eontrol 
he noted stiffness and pain in his -Joints 
and a mid fever. Laboratoiy exam revealed 
l^eiflotolnemia, a postive flourescent 
mtlbody test for antlnuelear factors, and 
a_ positive lupus erythematosis preparation. 
The picture is most litely due to- 

a) SysteMo lupus erytheraatoeis. 
■b) IftnaralaBlne toxicity. 
0) Kieumatoid arthritis, 
d) Methjrldopa toxicity. 
G 



Correct Answers* Annotations, 
and References 



Answer! b 

The picture is consistent with hydralaslne- 
induced aupus. IMS syndrome is most conlon 
m patients on hydralazine who are white 
slow-acetylators, that is slow raetabolizers 

ZJ^^^^"^* ^^""^ laboratoiy findings 
described, and do not have evidence of renal 
involvement. 

Bcf , : Areiv, J.-_ of j,fe d , 49 ■ 519 • 70 



ERIC 



Sample Self-Assessment Questions 



I Journal (please type) 



1 



Article Title 



HvpR-rhRTififnn 



The Amerlean JouT^ al of ^fedleine 
3 Ufi Simdrome 



Senior Author 



Publication DateOet,, 1970 



In the space below please type multiple choice questions and answers generated 
from the article listed above. Questions and answer choices should appear in 
tha lefthand column; correct answers, annotations and references should appear 
m the righthand column. Indicate whether a questions is specialis t-applicable 
generalist-applicable, or applicable to both groups by putting a ♦^S^* or " ' 

"SG" in the margin to the left of each question. Return to PMI SO^The Fenwav 
Boston, Mass. 0221S. - ine renway, 



Questions i Answer Choices] 
fi S, SG Designation 



An elevated peripheral -vein renin In a 
patient mth hypertension la most consistent 
mth: 

a) in autonomous aldosterone-produoliig 
tiiror; 

t) Unilateral renal artery stenosis, 
q) Essential hypertension, 

d) Malignant hj^ertension. 

e) None of -toe aboTO. 
S (cardiologist) 



Correct Answers^ Annotations* 
and Ref e rences 



iERiC 



MmBTt d 

The only hypertenslTO oondltion in which 
a s^temlc Increaae in plasma renin is 
found conaiatently is malignant hypertenalon, 
ThB Inoreaee in renin activity Is probeMy 
not reaponelble for the hypertenslom, but 
rather a aoneequence of It. Unilateral 
renal arteiy stenoela or other conditions 
with renovascular h^erteneion may have 
elevated renal vein renln^ but have normal 
or even low peripheral-vein renin. 

BBf , I AMr._J_. _ of md 49 : 519 : 70 



f 



Sample Solf-Asssssmcnt Questions 
I Journal (please tyDel . . * 

Article Title Hyper-tenelon and the Lupus Smdrom 



Senior Author: 



Publication t 



the lofthand column. correct .nsw\rs!'"L»ti:: " f 

m the righthand column. Indicate whether a n,,*» = ^' should a 



r 1970 



r in 
ppa ar 
icable 
or 

enwax # 



Questions* Answer Choices 
G, SG Designation 



H3nflralaz1.ne- induced lupus-lil^ ' syndrojne 
la oharacterised by vMch of ttie following: 

a) MQet eonnson in rapid acetylators* 

b) Frequent renri Involvement, 

o) More frequent in Negroes than CauQaslang 
on hydralazine, . . 

d) None of the above. 

S (lnte3rniat) 



Correct Answers| Annotations' 
and References 



Answer! d 

Hydralazlne-indueed lupus-lite syndronie is 
nearly^ always found in slQW-acetylators^ that 
Is patients ?;ho detoxify hydralazine slowly 
by aoetylatlon. Further^ the eyndrone 
is rarely seen In Megroea and rarely invol-res 
the Iddnej^, Once liydralaBlne la mthdrawn, 
syjTptone related to the syndrome regress 
rapidly^ but the mtinuclear antibody titers, 
may renmin elevated for months, 

ftef*: ATOr. J. of Med.^ 49-519'70 



lERLC 



Sample Self ^Assessment Questions 
Journal (please type) Arorican Joumal of ivfedlcine 

Article Title Hypertension ajid -m Lmug fiipidrpnie 



S e iii d r Auth o r : 



Publication DateQQ^^. 197Q 



In the space, below please multiple choice questions and answers generated 

th'e 1 fth'T^'i ^"d answer choices should fppear iS 

the lefthand column- correct answers, annotations and references should appear 
in the righthand column. Indicate whether a questions is speciaUst^apnlicable 
goneralist^appUcable. or applicable to both groups by putting a '-S"! ' 
Boston" Jass^'lanr ^ '''' °' question. Return to PMI. 3o'The Fenway, 



Questions^ Answer Choices; 
S G, SG Designation 



The role of prostaglandin In nomal human 
phyaioiogy is not yat clearly alluoldated. 
Pooslbla roles would Include: 

a) Seire an antihypertenaive endocrine 
fimdtlon^ 

"b) Act as a vehicle for spem trm^ort. 

q) Serve an mtibaoterlal function for the 
prostate and urinary bladder. 

d) None of the above. 

S (internlat) 



Correct Answers; Annotations*, 
and References 



MlBWBTl a ■ ^ 

Prostaglmdln, a fatty acid found In the 
medulla of the Mdney causes vascular imooth 
nuEcle vasodilation and a fall in blood 
pressure, it may vmll play a role in the 
normal regulation of blood pressLira by the 
Mdney, Possibly It's absence or .a deficiency 
may play a rni.e In tiie geneeiB of hypertension, 

Itef p : Ane r. J. of Mad_ 49:514:70 



Sample Sal f ^Assessment Questions 



Journal (please type) Ajrerin^n Joumal of MediajTig^ 



Article Title 



PBeudoQoarctatlon of tiha Aorta 



Senior Author: Dr, Teung 0^ Cheng 



Publication Date Oct.* 1970 



In the space below please t)^ multiple choice questions and answers generated 
fr^'i f listed above. Questions and answer choices should appear in 

the lefthand column; correct answers, annotations and references should appear 
in the righthand column. Indicate whether a questions is spec i a 1 i s t - app 1 i cab 1 e 
genaralist^applicable, or applicable to both groups by putting a **S" or ' 

"SG" m the margin to the left of each question. Return to PMI SO^The Fenwa- 
Boston, Mass. 02215. " rtnwa^ , 



Questions* Answer Choices; 
5 Gj SG Designation 



A fifty-one year old male presented to a 
phj^ielan "beoauee of djrsphafla and cough 
of 4 months duration, ^ Chest X-ray revealed 
a ST^erlor nBdiastlnal mass. Aortic 
OE'tiieterlzation and aoi^ography revealed 
elongation and ilnldng of the aortic 
Isthmus, aneurysmal dill tat ion of the proxi- 
mo portion of deecending aorta^ and no preS' 
sure gradient along ttie aorta. Physical 
axM would laost lltely reveal' 

a) Radlri-femoral pulse delay and suh- 
coatal arterial puleationa. 

h) HjTpertenelve ehangos in the eye gromidi. 

c) A muCTur heard heat over the hack^ and 
no other ahnomalltles, 

S (cardiology) 



Correct Answers | Annotations* 
and References 



-Ansror: g 

Ihe presentation is most consistent with 
peeudocoarctation of the aorta^ an anomaly 
which usually presents as a superior TOdlastlnal 
mass and a niumxir heard at the base of the 
heart and over the upper haok, Ihe munmir is 
thought to he due to turhulBnce caused by the 
elongated ^and Mnted aorta. In the eva].ua- 
tlon of superior TOdiastlnal masies, it is ' 
in^ortant to recognise this henlgn syndrome^ 
as it can closely mimlG conaitlons with much 
rnore omious prognoses, 

^tef* J. of Ifed, 49^459:70j 

Ajner, J', of Oardlol,_ 24 -548: 69" 



ERIC 



SamplQ Solf^AssessmQTit Quost ions 
Journal (please type) Ajnerlcmi Jpi mial of Medicine 

Article Title PseudocoarotatlQn of the Aorta 



Sonior Author 



In 



Publication Dateoot.. 197O 



the space below please type 
from tho article listed above/ 



multiple choice questiDns and answers generated 
Questions and answer choices should appear in 
tho lofthand column- correct answers, annotations and rcforencos should appear 
in the righthand column. Indicate whether a questions is spccialls t==applicablc , 
generalist-applicable , or applicable to both groups by putting a "S'^, '^G** or ' 
'*SG" in the margin to the left of each question. Return to PMI , So'lhe Fenway 
Boston, Mass, 0221S. ■ 



Questionsi Answer Choices; 
6 S, SG Dasignation 



A flfty-ona year old jnachlne operator with 
vague complaints of dysphagia was noted on 
chest X-ray to have a superior mediastinal 
mms^ Kie differential dlagnoatlc Gonslde- 
rationa shoiild includa: 

a) Coarctation of the aorta, 

b) PseudoGoarctatlon of the aorta. 

c) Ectopic thyroid. 

d) All the ahove. 



Correct Answers^ Annotations^ 
and References 



Aneweri d 

All toe ahove conditions can present as a 
superior iiBdiastlnal mass* The post-stanotic 
dilation of coarctation can resemble a masa, 
Ella dia^osis can be made by pl^yalcal 
exam usually* Pseudocoarctatlon of the 
aorta ^ a benign "buoiaing^' of the aorta 
with no coarotatlon can present as a mass 
and may req;aire aortography to verify its 
presence. Ectopic thyroid tissue can 
usually be diagnosed by thyroid scanning 
of the chest p 

Ref,: Amer. J . of Med, 49i 551:70 



} 



lERlC 



i. 



I 

f 



Sample Self ^Assessni Gnt- Quostiong 
Journal Cplaase type) America .Tn nTOel of tedlcln. 

Article Title Zoater. Hglnfeotion or Aotlvation of Latent Virus? 



Sonior Author: Dr, Laurenoe Mller 



Publication Date Oct. , 1970 

^ ' - — ' - . 



In the space below please type multiple choice aue^tinn^ .^a 
from the article listed aboveT QuestlonS and anlweJ ^Lf '"^'P S^'^erated 
the lefthand column- correct answers an lotati o^S , / ^"^ ^PP*^^' 
in the righthand column. Indicate whether fn. ^^f^rences should appear 
goneralist^applicable, or applicable to Joth^r^^ '?"' specialis t-^appl i Lb 1 
"SG" in the margin to the left ofeach question "^'p-f " ' " 

Boston, Mass. 0221S question. Return to PMI , 30 The Fenway 



Questions- Answer Choices; 
S S, G, SG Designatipn 



Which of. the follo?dng viral diseases is 
Imovm to "be caused "by me sb-TO vlruB 
as varicella* 

a) Heipes siniplex 

b) Herpes zostei* 

c) Ruhella 

d) Ruheolla 



Correct Answers; Annotations, 
and References 



Answer: b " ' ' ' ~~ — — — ^ ■ 

Heipes Zoster and Varicella are kno?«i to 
be caused by the same virus, it is not 
certain whether Herpes zoster represents a 
reinfection or en activation of the virus 
which has lain latent in-ttie host. Epidemiologic 
data would suggest the latter. 

Ref.: Amer. J. of Med. 49:480:70 



ERIC 



Sample Sel f -Assessment . Quest i 



ons 



Journal (please type) The Aneriean Joumal of ]fed3nin» 



Article Title Zoster. Reinfeotlon or Activation of J.n+^n+, 



Senior Author:^ p^. Laurence Millar Publicati on DateOct.. 



1970 



In the space below please type multiple choice nue^^ti 

from the article lifted abiffr Questions and an war choices'^ould 

the lefthand column; correct answers annot^fit * should appear m 

in the rlghthand column. Indicatf^het^erf que tioL"" 'PP^" 

goneralist-applicable, or applicable to both%?ou rb^P J^ra^'s^^ 

B to ; M :s^^l22ir - O-Th P way. 



Questionsi Answer Choices] 
6 S, SG Designation 



Herpee Zoeter and VaricQlla are" toiovm to be 
caused hy the sane virus. ITiere are^ how- 
ever^ epideMologie differences tetroen 
the too dleeases, which inclide* 

a) Heipes zoetar has no eeaiona3, v-arlations, 
while varieella IncldenGe peaks in the 
winter. 

h) Patients with varicella have a high 
lncide.tice of recent ei^oeure to the virue^ 
while patients with zoster have a low inci- 
dence of recent expoeure. 



Correct Answersi Annotationss 
and References 



Answer^ d 

Iheee epidemiologic facts lend support to the 
thesis that Hei^ee zoster is not reinfection 
with me virue^ hut rattier is activation of 
the virus which has "been latent in the host, 

Ref I Ajner. J. of Med. 49:480:70 



c) Patients mth tlie highest attack rate 
of soster are the least lllcely population 
to he exposed to patients ?n.th varicella. 



d) All of the above. 



Sample Se 1 f - As s es sment Questions 
Journal (please type) Thm MmrioBn .in^^^sx of Medicine 
Article Title 



The Pacemater Sound 



Senior Author- py, Morton IfnTTi 



Publication Date Oct, , 1970 



th. lofthand co:u«„; correct ansSe^r! ""^o 10%" ":;,= e^^^ltJ^rJlfo^fr" " 
in tho righthand column. Indicate whether a gees t i ons * , appear 

generalist-appucable. or applicable to both gjoojs bTp^tt H a° "S" -^iJ''""''- 



Questionsi Answer Choices; 
^ S, SG Designation 



i A high-pitched^ clicking pregystollo sound 

ie of tan heard after insertion of a trrasve- 
I ' noue pacemater, Ihe sound should warn the 
I physician that: 

j a) One of the wirea ^-Vhln ttia catheter has 
I broten* 

^ "b) ThB catheter tip has perforated the right 
I ventricle and prevented pacemlcer capture 
i or Bensing, 

:| c) The catheter tip has penetrated tlie right 
I ventricle but still probably .captures md 
senees prope]" 



S (cardiology) 



Correct Answers; Annotations* 
and References 



An^Ter: c 

The presyBtollc click which is heard 
occasionally after trensvenous pacer In^lanta- 
tlon probably represents catheter penetration 
of the right- ventricle wall, eitffuciently 
far enough to produce intercostal muscle 
twitching, but not far enough to produce 
failure of the pacer to capture or sense* 

Refi Amer, J, of Med. 49 ! 451 1 70- 
^Iw.ir^^feii, 68:1320:68 



ERIC 



Sample Se 1 f ^ As s ^men t Qu estions 



Journal (please type) 
Article Title 



Senior Author :_ Pr, Iteton Kom 



Publication Date Oct,, 197C 



the lefthand column; correct .ns«rr"r^„"Monr"/''°i"' '"P'" 
'n tho righthand column . Indicate whether a = 



cnerali3t.appUcaUe. -or appllc^^^e^o';^:?, V.":?^,^-,i.%^P-j^^J^°-| 



•'SG" in the margin to the left of each question 
Boston, Mass. 0221S question 



Return to PMI 



30 The Fenway, 



Questions' Answer Choices; 
.6 Sj G, SG Designation 



A seventy year old male was seen one year 
. after In^lantation of a transvenous demaiid 
pacemater. Auscultation revealed a Mgh- 
pitolad, presystolic oil ok. Tlie proper 
course of action for the pl^ielm should te 

a) Arrange for early replacement of the 
■battery paQlc. 

b) Obtain a PA and lateral cheat X-ray to see 
If the eatheter tip has changed location 

J c) Do nothing, for this soimd has the charac^ 
I tflristics of an ejection cliclc. 

, d) Do nothing, for this scimd has the 
I characteristics of a presyBtoHo ga 

S (cardiology) 



Correct Answers j Annotations-, 

and References 



pie presystolic click has been described after 
trrasvenous pacer iirplantation. it: Is thought 
to he aue to intercostaJ. muscle twitching and 
i^present partial penetration of the rlpht- 
yentricle hy -Uie catheter tip. Because there 
IS rarely loss of capture or sensing, reposi- 
tioning of the catheter is not usually 
noceseary. Chest X-rays may demonstrate 
a slight oateratlon in the position of the 
catheter tip. The presystolic sound is too 
hagh-pitchsd and distinct to he a presystolic 
ga3.1op, occurs hefore the first heart sound 
and tnerefore Is not an ejection cliclc. ' 

Paf • Amor. J. of ifed_ 49 ; 4 51 . 70 , 
ife!.,JStj,JM.. 68:1320:66 



ERIC 



Journal Cplease type) 



Sample Self^ Assess me nt Ques ti 

on 



ons 



Article Title Exerolsa^Induced S~T Seroient Elevat.i, 



Senior Author; 



I - - — — dup lication Date Oct,, 1970 

I In tho spacs below please tvDe multini^ ^hr^^^^ ^ ^- 

from tha article listed ab^ QuesJionJ anl generatad 
, the lofthand column; correct answer ^anLt^JionrandleJ^^^ "PP^" 
j m the righthand column. Indicate whether a aue^tfon, "' ^PP^'" 

^ 8™i--PPli"ble, or appncable tfS^th^?: rbrpitti^rr's"^ 



Questions* Answer Choices; 
. 6 S, G, SG Dasignation 



I In a patient whose EKG reveals S-T segnBnt 
elevation during or shortly after exGrcise^ 
^ coronary arterography Ig most lltoly to 
I reveal: 

^ aK Mffiiae' corona^ diseaee involving all 
I tpajor veseels, 

b) An occluded^ or nearly ocoluded rnajor 
I TOseel near its origin, 

e) Normal ooronaiv angiograme, ThB disease 
I Is most lltely sjnall=.veosel dlGeasG not 
I seen by arterography, 

S (cardiology) 

f 

i 
i 



Correct Answers^ Annotations* 
and References 



Anm^er* b 

Nearly all patients who hmm S^T segnBnt 
elevation ^Ith or follomng exercise have 
a lesion occluding or nearly occluding a 
major vessel near Its origin. The other 
vessels may be either noraial or diffusely 
Involved, 



Ptef { 



^ffl<'J?rt*.Jfea^ 68:1320:68 



ERIC 



1 



Sample Sel f - As s es sme n t Questions 

I Journal (please type 



[ 



Article Title 

Senior Author 
In 



Pr. Nlchnlfls J. Fort -m-Ti 



Publicat ion Date Oct.. 1970 



Jrof ■Hf;^?i^li°LPj:rL||f^ '""mill^^l'i^ .ns.ers' generated 

the lefthand column: correct ..,w«^f "!„L":. . should appGar in 



in tif r?^h?h'°J"'""^ -^o^^ect answers, annotations and 
m the righthand column. Indicate whether 



retorencos should appear 

generalist^appUcable "or alulillhl ^'^'ITu'^L^ questions is spe c i a 1 i s t -app i i cab 1 e 

••SG.. in the "rgin to'the lef of L^h ,uestiln"'%'r ' 
Boston, Mass. 0221S. °^ each question. Return to PMI. 30 The Fenway. 



Questions- Answer Choices; 
6 S, G, SG Designation 



The occurance of S-T segment elevation 
duriiig or shortly after exerciBe is asso- 
ciated ■sTlth: 

a) A good progiiosis heQause the EKO changes 
signify a TOll-developed left- ventricular 
ane-urysra, 

b) A poor progriosls because of the Mgh inci- 
dence of sudden death. 

e) No slgiilfloajit alteration in the procnosls 
con^ared to otlier patients with coronary 
artery disease, 

SO 



Correct Answers; Annotations 
and References 



Ans^ver' h 

An EKO change of S-T segmnt elevation during 
or following exercise Is associated with a ' 
severe proximal coronars^-artsry ocolusicn 
and a high Incidence of sudden deaiii. 

Paf : Amer. J. of Lfed^ 49 : 4 59 1 70 



I Sample S elf-Asses sment Questinn^ 
Journ'ai (please type) p»h<....„ 



I Article Titli 



I 



1 



hp Trpfl f n P nt: of Cvfini dp B^n'anninp in n hildren 



Senior Author: 



Ches ton M. Ber 1 i n . Ji 



Publication Date Nov. 1970 



In the space below please type multiple choice nueqti«„= ^ 
from the article listed aboTtT Questions and Y"tllr t answers generated 

the lefthand column- correct answers anno^^ti ^ "'" ^PPe^r in 

in the righthand colu.n. " In^^tLl^TT^l.t^/lt'l^^^^ 

Boston, Mass. 02215. ^ question. Return to PMI , 30 The Fenway, 



Quest ions 
6 S, G. 



Answer Choices 
SG Dos ignat ion 



Correct Answersi Annotations- 
and References 



SG 1. Proper nana^ement d£ cyanide noiRon 
ing includes v;hich of the followxn/^: 

a. emesis with ipecac syrun 

b, aiiyl nifcrilc by inhaUition 
intravenous treatnent: wiLli 3% 
sodium nitrite, 

d, intravenous treotnent with 25a 
sodiuri' thiosulfatop 

SG 2. The widely pubUshed ischedule for tl ^ 
treatnient of cyanide poisoning by the 
nitrite thiosulfate method of Chen in 
potential ly^ letlial for chl 1 dren under 
25 kgm. in weight. 



asb,c,d.. Thi^ is the reconmended cour/;e of 
thcvapy for the reneremeTit: of acute cy^^nide 
pnisonin^, 

Aren£^, Poi^on:nr. Sprii n^if ie I d . IIS Charles 
C. ThDncs, p, 22,^ 1963, 



3. Successful treatnent of accidontal 
poisoning in children requires an 
accurate history because over treatinent 
can be as danperous £s the rislc 
poisoning itsel f . 



ERLC 



Ti-UQ, The um of the fldull; dose for nitrite 
has produceri fct-fll mGthemonlobtner.j .n j n a" 
child. The dose of KaKO for children wj th ti 
heiMorlobin of 12 pn./lOO ni], <s 10 mr-n/kpn. per 
body waipbt Imediately and 5 nipm/kpm. rcncated 
witr-in 30 !«inuLes if nccossai-v.' 

Berr:'n, PfjH., 46:794, 1970. 
Chen, JAMA, 162:1154, IfSA. 

True. In ilHfl caoo re:ip-t, failure to accurafe- 
ly wicuUte Che dosQ of inf^ested cvfinidP 
1/50 fp I/IAO of the publishod letrhnl doRo of 
cynnide Jeod ;:n t.hc fidnMnlsLrrHion of a lethal 
dnsn of rffir;o,. 31^11 Gwncir Nonces .m.ch 
•na use ol f iuH nxtracf of Ipcrac an ernetjc 
T'^svcccl of Ipccnc Syrun hns rise rcnul Led In 
r'nrtfi'ity. Cm-o r i;"ea (Tien !; corrjoG itn own 
norbidiry! 

Efii"Un. I;'Gd.. 46:774. 1S70. 

^;l;)Qr:, in Gellfs and Karan, Current; Fodiatri- 
Thcrn'iy, Vul .5, 1971. " • 



Sample Self^Assessment Questions 



Journal (please type) ^Bdin tria^ 

Article Title Sovbefln Sensitivity: Cass RWport 



1 

I Senior Author: Josef ina flandoza 



publication Date Nov. 1970 



I In the space below please type multiple choice questions and answers aenerated 
I from the article listed above. Questions and answer choices should appear in 
the lefthand column: correct answers, annotations and references should appear 
m the righthand column. Indicate whether a questions is s pec i a 1 i s t -apnl i cab 1 e 
generalist-applicable , or applicable to both groups by putting a "S" "G'' or 
"SG" m the margin to the loft of each question. Return to PMI, 3o'The Fenwav 
Boston, Mass. 02215. - * 



i G 



Questions^ Answer Choices- 
S S, SG Designation 



I- Soybean is v»idaly used a subnt-^- 
f:ute for eou's rnilk becau.^e covj's ntiik 
Is o common source of nllGcrlc difiorder; 



2* Soybean is a completely nnn-al ^ cir^'lc 
nroduct* 



Correct Answers | Annotations' 
and References 



3. The propliy 1 oc?. 1 c use of hynofi; terpen i 



forniulaG vary ?iUoly ^ ©so ens uhe ^'ncic->ence tliis flrd 
.of major aUerfvlc dirouders ouch cc^cr 
ond aGJ:hma* 



TT'uej True, Related. Soybean is widely used and 
cov' B 1:1] Ik is n-in of i:hc conTionest sources of 
a^-eir/^^c dlf^ordcrs ir^^ children^ 

Glascr ct. gU , JAMa; 153:620, 1953, 

FrIsG, Snybean Is capabl-e of producinp sensltiv- 
ily rQQCl iorn afl-ov reper.t oxnosure to tlif? 
P rod u c ^: and c? 1 1 1^ n uf ^ h ur c onno li na y be e k t v erne 1 3* 
soverc. Tlie ^'Tdeapraad use nf soybean formulas , 
\nA \ rGSUi t; an increase In these rcacfcions* 



zed. , ]6'774, 1970, 



c Triie , . G*asei" ^irs data that r^tronriv surresl-S 



I'ov;eva'% any nrophylact'c 



ro^^T!':©!! i 'f'^' cc^'^'v 1^ 5 own vi^^'s £^nd rat^^cr than 
flfiy bear a^^;! voir ted nubs I: J Lut: c:.u brcii^ut !"iMc 



1 



ERJC 



Journal (please typo) Pedf.at-.vj 
Article Title 



HodFhtn'B m^pp',p in rhr First; DecQde of M f ^ 



Senior Author. gtcnhcn R. Strun 



^Publica tion Date 



Kov . 



197L 



f?ortho^:^ticle°n r Llff^ ^1 L ° ^"^"^-^ --ers s.ner.ted 

the lefthand column; cor ro answers anL tat i ^nf'^^ ^'^^"l^ 'pP^" in 
in the righthand column. Indicate whoJhor a "" Jot"'"'""^ ^^'"^'^ 
generalist-applicable, or ann 1 i cab 1 g r n questjonb is s peci al is t - appl i cab 1 c 

■•SG" in the margin to'the lef o? eLrquo ^1""^%'^ ^ "S". or ' 

Boston, Mass. 0221S. question. Return to PMI . 30 The Fenway, 



Questions; Answer Choices' 
§ S, G, SG Designation 



Correct Answers^ Annotations-, 
and Referenciss 



SG 



SG 



1. SplanonopQly is the r.iost common 
presentino syrn-itom In Ilad-kin's DisQaso 
in Chlldi-Gn in the first decade nf 1 j f n 



2. Modgkin's Disease in children n 
disaase predominantly of nalcs usnniiv 
over tho ape of 3, 



3. Histologic study of children with 
Hodnkin's. diseas'Q shows a strikin-- nre- 
nondcranc€? of mature i yn-JhocvLe-; . ihia 
suggests 

a. riost could not be classifinri. 

b. a parCicuiar host resoonGn 
characteristic of the difioiisc 
in children. 

. c. a direct relaUionshiii witi-, 
perifihera! ijhc, 

d. many Sternberp, Mfjed 

e. one oat ho in- '..if:. 



Fe:l»c ! ihe mat Modrkin', disease, a. vmptoni- 
auc lynph nndo invo] ver.ent is tho r-ost common 

St run, red, . 46; /A", IQ70. 

True In this Rcrics, as in others, over 90^ 
n _tha reported c.ses ^^c males. In addition, 
horU urns a-nen-s very rrre in children under 3. 

Si run, = cd. , ^P;74n, 1970. 

h. The cnnnon histolnric fef-ture could represent 
<' C'.flrncf:c)-i„t::r host rns^onse' nnst verc ^ 
c ■fujniEicd. ' ho-Q wi^r no relflt-inn lo the 
-icri,i,n:;-s] „bc, and in fact Hternberr Heed cgI's 
^^ern riTC^y cbsGr-t. s ^ pof^njbM ^ tv' 

-nci-D ue-O 2 l^'-i 'lo^oristf! in this siiuh,, ' 

3" -u; , :;od. , 4«>:7^'' , l?/'!- 



Samp 1 e Se 1 f - As s es sme n t Questions 
Journal (please type) pgdiatrxcs 



ArticJe Title _Cflre of the CTixicaWy III Ch<id: The Problnr^ of Disner j natied Intrnvf^^cu U r 
_ Cqaculat:lon ^ 



Senior Author: WilUam E. Ilgnhauay 



Publ ication Date'^ov. 1970 



In the^spaca below please type mulrfiple choice questions and answers generated 
from the article listed above. Questions and answer choices should appear in 
the lefthand column; correct answers, annotations and references should appear 
in the righthand column. Indicate whether a questions is s pec i a 1 i s t ^ app 1 i cab 1 e 
g^neralist^ applicable, or applicable to both groups by putting a '\S*^ '^G^^ or 
"SG" m the margin to the left of each question. " Return to PMT 30 'the Fenwav 
Boston, Mass. 02215. railway, 



SG 



SG 



Questions- Answen Choices; 
5 G, SG Designation 



I- V/liich of the £allnv;inr has diu- 
serninaUed Intravascular coanulntinn been 
observed as an etiolor/c or cof:-pUc/iL inr 
iriGchanism in * 

a* idai^^pathic respiratory d^slross 
syndromo . 

memlnnocqccal senticeriia. 
varicel la. 

Rocliy Mountain spotted fover. 
neuTOblastoma* 



b. 
c . 
d. 



2. Multiple systicn (brain, heart, '-id- 
noy, lunn, end red cgHs) Involvepent 

a seriously U l chi-d sh:nild mrroty: 
dis:ierunated intravajjcu) nr coar'U ' o tinn 
ev'in without purnuric 5li5n lesionri, 

3. The laboratory dicpnosis of UIC 
sncludes al\ but one -"f the fnllcuinp,; 

a. abnoTr^l 'Drniihror^bin tire, 

b* burred erythrocy t:es . 

c. HelnE bodie.i. 

d. lowe^^ed platelet; count. 

e. iav;erGd pro thro: :b^ii l:ii,,a. 

4. v/hile hc;?ariniaation does corrnct 
abnormal clot^ini^ in scvereJy V] 
patients in DlC, It does not sinnificnr 
ly irrprove tlie nnrtnlity rnte. 



ERIC 



Correct Answers; Annotations* 
^and Re Terences 



C'c/^-. The n'^rhcr of cilnicnl conditions v^hen 
Die hrs hco^' nbr;^rved i;; ^arre. 



Ivue. /A ^ of t>o"0 Fyni'Jtnnj^ ncy annesr before 
lir l;h^-.'fiy , ^^c^^ ^6:7675 1P70. 



c. Tl^c rin": UM of laboratovy findinr-p needed 
to :^!r':c r 6ir.yvoc]js InciMde abno ra 1 ? i ? es of 
>rol^rc5!rbin, rorbjr, and 1 owertid ^"^"fitGlcC 
cnun;.. The bn^^^^ ccMs n^^o 'ho basir for the 
her oi }'tic rnor'la, 

llflhr-ay. Ted, Afi-767^ 1570. 

Truo^ In add^tinn tn bGna"iniz£^t< on It" is 
neccspG^'y to pvov^de supportDve care end support 
nf the circiuatinn with p-annn blood, and ' ' 
inoynte-ono^ r ay be Jifesavinn, 

Hrii^aurv , '^^d , . 4fi : 7-^7 . i 970 . 
Cnrvif":r-i el. c/ . . Ccvbinad l/rof^rnn and 
/ibDtrac*:n, The /.ncricrn i/oniatri.c Snr^ety and 
the Gncietv frr ;^eniatr?c l-ecrc-ch, /t^r-^tic 



Sample Self-Asgessment Quest ions 
Journal (please type) Pedintrica 
ArticlG 7'itle 



JCidngy Trginsnl antt^tlnn in Child^^gn 



Sonior Author: HichQel 



ante 



Pub 1 i cat ion Date 



iov. 1970 



In the space below please type multiple choic- questions and answers genorated 
from the article listed above. Questions and answer choices should appear in 
t:^ . lefthand column; correct answers, annotations and references shouJd appear 
m the righthand column. Indicate whether a questions is s pec i a 1 i s t - appl i cab 1 o 



goneralist-'applicable , or applicable to both groups by putting'a 
-'SG" in the margin to the left of each quostion. Return to PMI 
Boston, Mass, 02215. 



tig, 
30 



or 



The Fenway, 



SO 



Questions^ Answer Choices; 
6 S, SG Designation 



1. All of the follouinp, statenenLs 
OKcept one are true* '^.ich one in in- 
correct? 



Correct Answers? Annotations* 
and References 



C't ron 3 c /' 1 0! 
cansD of to^ 



a. Kidney transpL:!nts are nnre 
successful in living ycrsus 
cadaver donor Uldnevs* 

b* Pye lonophri Cis in the CfinmonQst 
cause for terminal renal failu! 
In children. 

c. Growth continues after succGR5;f[i] 
transplantat inn , 
The complication rate in renal 
transplantation in children j. s 
hiph, 

SG 2* Complications of renai rronspl an' ati 
that occur earlv Include '^ociMrica^ 
dif f icu 1 1 i Gs , immtino lori cal disDrdern , 
and sGcondary infection. 



3. Renal transplantation in children is 
now so e n c o u r af i np. in i s res u 1 I a t h a t 
lar|?G ycale prorirans should be devcloned 



[^intG et 



'orii 1 onepbri tig is the cornnionest 
^inal renal failure in 



red. 46:665, 1970 



i.nnt: friiiiros occur oaT'H* and v;'^i3e 
tii 3 ' rcss i '^^^ cro cr'^rbie of Rolutior. late 



and drnr lox 



1 



a n f: 0 r ' 



1970 



in c?^^ ' drnn ! nan ndn ■ 
r^adc by conrent rnt i nr 
CGntc ra . 



pmcedure ±^ much mnre difficult 



Pror/resB wi 



be 



;'rrar^s in 



Jai^lnntc ai . l/ed, 46:665, 1970 



Article lit! 

infants 



Senior Author 



■ - — — Roger n . Sfftunne^n Pub 1 1 c -jt i n,+. 

— — — — ~ — - — f u D 1 1 c a r 1 n Ti D a t e iN o v . 1 9 7 0 

In the space below please typo iiiultinle chow-. —~ 

from the article listed aboffr Que Jont^nd "^'^^^""l answers goneratcd 

the Icfthand column; correct mswer! and answer choicos .should anpaar in 

in tho ri«hthand coiu.n. "rJdC:^^ ho ;:rr5°^:u:^ shouli appear 

generalist = applicable, or applicable to ntK -^s spec i a 1 i s t - appl i cab 1 e 

"SG" in the margin to the ^fft □? -^.h ■ ^""P' putting a "S". "G^- or 

Boston. Mass. 02215. ' °' question. Return to PMl , 30 The Fenway, 



Questions- Answer Choices 
5 Sj G, SG Designation 



SG 

An 18 month old boy was admitted to 
the hospital with hypernatramic de- 
hydration because of gastroenteritis 
of two days duration. He was also 
found to have a blood sugar of 416rng 
lOOnil, without acetonemia, acetonuria 
or glucosuria. On the basis of this 
data, the boy should be considered to 
have dibetos mcllitus and thus begun 
on msulm therapy. TRUH or FALSI] 



Correct Answers- Annotations, 
and Reforences 



Ans. FALSO. This child does not have 
diabetes mellitus but "suspected diabetes 
mollitus-' according to the Committoo 
^rotessional Education of the American 
Diabetes Association. The other cate- 
gories are. "overt diabetes" where there 
IS tasting hyperglyceniia in the absence 
o± stress and a glucose tolerance test 
IS not required and "chemical or latent 
diabetes where the fasting blood suBar 
IS normal but an oral or intravenous 
glucose tolerance test in the absence of 
stress IS m the diabetic range. In 
this case, the hyperglycemia was con- 
sidered to '^ave boon causeJ bv the stress 
situation .d the blood glucose returned^ 
to normal limits with appropriate fluid 
therapy. One must bo careful not to 
treat these children with insulin unless 
there is evidence that the blood sugur 
does not return to normal levels follow- 
ing fluid replacement. 

Uef . llyperglycemia with hyperosmolal 
dehydration in non diabetic infants 
Journal of Podia "tries 77:S18, 1970 
Textbook of Pediatrics IV . B . S aunders 
Philadolphia 1969 p USSff. 



ERIC 



Sample Self -Assessnie nt Questions 
Journal Cpleas. typoj^n,, Pediatrics . 



; Article Title 



■Jj^pgrglycemls wi t h h vn o r osmo ] a 1 4. non diabetic- infants 



Senior Author; 



Roger I! Stevonson 



Publication Date Nov . 19 70 



In the space below please typo multiple choice aue,tinr,« 
trom the article listed abo?i^ Questions anH ^"-^^""s and answers generated 

Boston, Mass. 02215. question. Return to PMI , 30 The Fenway, 



Questions- Answer Choices: 
6 S, G, SG Designation 

An 18 month old was admitted to the 
hospital in a s emi comatos e statu 
He was in a perfect state of healti 
until two days prior to admission, 
when he developed fever and 
diarrhea, He refused to eat 
solid foods but drank and urinated 
greater amounts than usual. There 
was no previous history of poly- 
uria or polydypsia. There was an 
inadoquate family hibtory because 
he was abandoned by his parents. 
On admission, his temporature was 
104^F BP 9S/5S r.spirations 24/mln 
and he was thin, malnourished, and 
extremely dehydrated. Serum 
electrolyte Na 164, CI 134, C02 
blood sugar 416 mg/ 
97 hematocrit 34, 
Urine : Ph 5,0 S , G . 
none, acetone none 
Soruin acetone-no increase. Besides 
treating him for hypernatremic 
dehydration, one should give him 
regular insulin IV for the diabotoi 

True or false 



21. O3 

100 ml 3 BUN 
WBC 15,700, 
1026, Sugar 



ERiC 



Correct Answers 1 Annotations^ 
and References 



Ans Falso, This patient should not bo ^ 
treated with insulin and does not have 
diabetes. This case is one of three 
children who presented with gajtro- 
enteritis, dehydration and hyperosmolal 
hypernatremia with hyperglycemia. Prior 
to the onset of the acute illness all 
patients were perfectly well with no 
prior history of polyuria or polvdypsia. 
In addition, all had hyperg ly cemi a wi th 
blood sugars ranging from 365-600 mg/100 
ml. None had acotonuria or acetonemia, 
and 1/3 had glycosuria. 2/3 were treated 
With small doses of insulin but at the 
time of treatment, the blood sugar had 
already fallen dramatically. One 
patient with a blood sugar^ of 517 mg/ 
100 ml was treated with'fluids alone 
and blood sugar returned to normal at 
the time of recovery from the dohydra» - 
tion. A glucose tolerance test a all 
patients was normal. The etiolggy of the 
hyperglycemia was not kno but may have 
related to the stress situation. Accord- 
ing to the Committeu on Professional 
Education of the American Diabetic Asso- 
ciation this state is called ''suspected 
diabetes mellitus'^ probably caused by 
the acute infection and stress. 



Ref. Textbook 
SMunders 1969 



of Pediatrics 
pllSSff 



Nelson W.B 



ilypGrglycemia with h; 
tion in non diabetic 
Ped. 77:818 "l970 



perosmolal 
infants J . 



dehydr a^ 
of 



Sample Se l f-Assessmenf Qn^^ t i on s 



\ (please type) The Journal of Ped^ 

Article Title Hypoglycomia in neonat«i 



ri cs 



s 0 p S 1 s 



Senior Author : q y 



^ ^ ^^DXication DateNov. 1970 



In the space below please tvne multini^- ^h^- 

from the article lifted ab!# Quos ions and' answers generated 

the lofthand column; correct answers annotationfH''n''' ^'^""^^ "PP«^^ 
m the righthand column. Indicate wheSerfnn.^ references should appear 
generalist = applicable or aDnlicahL tn , questions is s peci a 1 is t -anpl i cab 1 e 

"SG- in the margin to'the 1 ef J of each oL * • '""^^ a -S", "P or ' 

Boston, Mass. 0221S of each question. Return to PMI . 30 The Fenway 



Questions; Answer Choice; 
S S, G, SG Designation 



SG 

A neonate who has clinical sepsis 
should always have a blood sugar per- 
forined 

TRUE OR FALSE ' 



Correct Answers- Annotations- 
and References 



Anb. TRUE In a series of neonates with 
sepsis 20/S9 had hypoglycemia. Of the 
.0 with hypoglycemia. 0 wore nsympton.a ti c 

Ref. Hypoglycemia in neonatal sepsis 
J . of Ped. 77: 812 1970 



SG 

Hypoglycemia in 
associated with 



the neonate 



is usually 



1) 
2) 
3) 
4} 
5) 

Ans 

aj 
B) 
CD 
DJ 



Birth Trauma 
Adrenal Insufficiency 
Hemolytic Disease of' the newborn 
Infant of a diabetic mother 
Neonatal Sepsis 



1 and 

2 and 
1, 2. 
All of 



3 
4 

3 an d 4 
the above 



Ans : D] All of the above 

It is important to consider 
when one has a neonate with 
sepsis. In one report, 20 
sepsis had associated hy pog 1 y c emi a ; " and 
J ot tnese were . as ymp t oma t i c . 



oglycemia 
clinical 
patients with 



Ref. Hypoglycemia in 
Journal of Pediatrics 



Neonatal Sepsis 
7 7:812 1970 



ERIC 



Sampl e Sel f-Assesjinent Ques t ions 

Journal (please type) The Journal of Pediatrics 

Article Title 



Propylene glycol: A potentially toxic vehicle in li 
dosage form 



Senior Author: Gilbert Martin 



Publication D a t e N o v . 19 7 f) 



In the space below please type multiplo choice questions and answers eener^tPd 

'''''' = answer Choices should l^lr'it 

the lefthand CO umn; corroct answers, annotations and references should apnJar 
in the righthand column. Indicate whether a questions is s pec i a lis ?"appl f cab L 
gener.ust^appucable. or applicable to both groups by putting a"s" 'P'o" 

Boston! un^'l^lV: °' ^'^^ ^-way. 



Ques t ions 
S S, G. 



Answer Choi ces 
SG Designation 



Correct Answors; Annotations* 
and References 



SG 



A 15 month old boy was admitted to th 
hospital for an operation because of 
Wilm*s turnor. He received Actinnmy- 
cln D and radiotherapy. In addition, 
he received 250mg/day of Vitamin C in 
a susponsion of propylene glycol (7.5 
ml three times a day). Eight days 
after the Vitamin C administration he 
was noted T have a sinus arrythmia, 
tachypnea, cachycardia, and was un- 
responsive in bed. In addition ho 
had an intense diaphoresis^ 

The treatment of cho^'ce would be; 

a) glucose tolerance test 

b) discontinue Vitamin C in propylene 
glycgl 

c) emergency EEC 

d) phenob arb 1 1 1 I IV 



ans 



Propylene glycol has been used as a 
vehicle for a variety of medicines 
including Vitamins C and In high 

doses taken orally ?t can cause: 



-0 Petit mai seizures 

b) Degeneration of Betz 

c) Hypoglycemia 

d) T utricaria 



cells 




Propylene glycol been used in pre-, 

paring oral and injectible niedications 
and ran cause hypoglyceniia . Besides its 
use as a vehicle for Vitamin C, it is 
also used to treat infant^ with vitamin 
D deficiency. (600,000 uiuts of Vitamin 
D in a total volume of 60 ml. of propylene 
glycol given in one or divided doses in 
one dayO In the above case the patient 
was noted to be hypoglycomic and re-- 
sponded to 50% glucose IV, After the 
propylene glycol was discontinued, the 
patient was normoglycemic and a subse- 
quent glucose tolerance test was normal. 
It has not been appreciat id that propylene 
glycol is an alcohol and can produce a 
form of intoxication not too dissimilar 
to that resulting from overdose of 
cthano 1 . 

Rof, Propylene glycol A potentially toxic 
Vohicle in liquid dosage form 

J, of Ped^ 77:877 1970 

Ans , c) 

Hypoglycemia ■especially with large doses 
of propylene glycol. Propylene glycol 
an alcohol and can. produce a form of in- 
toxication not too dissimilar to that 
resulting from an overdose of ethanol, 

Ref: Propylene glycol as a potentially 
toxic vehicle in liquid dosage form 
J . of Fed. 77;S77, 1970 



Journal (please type) 



Saniple Sel f ^Assessmant Questions 
Jnurnnl of PodiatricR 



Article Title Rpiri^ m ir bnr i e f ^Q id pn j ^ nni^ ^^^mu 1 a t i n . .p hvinn.... 1 ..... 
epidermal necrQlysis of the newborn infant: Rl tter^s Disease 



Senior Author: 



A . Daniel Rub ens .in 



Publication Date Nov. 1970 

fJorthfart-^f^°T-Pi'f multiple choice questions and answers generated 

hn l'5th"H 1 and answer choices should Ippear in 

in tio 'i'h'h"d"'""i correct answers, annotations and references should appear 
m the righthand column. Indicate whether a questions is sneciaH^t ^nt^M.^Hi 

appacable to both gJoups^brp^ttiSra ^S^^^P^ f'^^' 



Questionsr Answer Choices; 
5 S, G, SG Designation 



Correct Answersi Annotations* 
and References 



SG The following have Chas) been a known 
, etiological' agent in epidemic toxic 
' epidermal necrolysis of the newborn 



i 



infant 



a) Boric acid 

b] Phisohex 

cj Staphxlococcus CRitter's Disease) 

d) Herpes Zoster 

e) Erythema toxicum 



3t True or false 

1 Boric acid poisoning in L,.e newborn 
•j infant presents like and is almost 

indistinguishable from staphylococcal 
^ toxic epidermal necrolysis (Ritter's 
i Disease) 



Ans • a) c) . 

Boric acid solution has been used to 

sterilize diapers. In one nursery a 

3% solution of Boric acid was substituted 

for distilled water in formula preparation 

and was responsible for three deaths, 

producing a disease similar to Ritter's 

Disease, 

epidemic boric acid poisoning simulating 
staphylococcal toxic epidermal necrolysis 
of the newborn infant- 'Ritter's Disease 



J. of Ped. 77:884 



1970 



True Boric acid solution has been used ' 
in the nursery to sterilize diapers. In 
one nursery 3% solution of boric acid was 
substituted for distilled water in formula 
preparation and was resnonsible for three 
deaths, producing a disease similar to 
Ritter's Disease, 



Epidermal boric acid poi >ning 
staphylococcal toxic epidermal 
of the nowborn infant: 



simulating 
necrolysis 



Ritter's Disease. J. of Ped. 77:884, 1970 



FRir 



Sample Self-Ass essment Questinn^ 
Journal (please type) The Journal nf PedUj ric^ 



''^'^^ -Epidemic boric acid poi s onin.^^^nT^^^^^^^^^^^^ 

Senior Author: . . , „ , " 

~ ° ^ '" ^" ' ^ ^ Pll l Lajm^ijL__^ Publication Dat^M^^^_T^ 

Boston, Mass. .02215. question. Return to PMI , 30 The Fenway, 



Questions I Answer Choices; 
§ S, G, SG Designation 



There was an outbreak of a disease in 
the newborn nursery characterized by 
fussiness, refusal to sat, vomiting 
diarrhea, exfoliative dermatitis and 
death. Three out of four Infants died 
The ^-Qur infants were born within four 
days of one another. In two, coagulasi 
positive staphylococcus aureus, phage 
type 7, was isolated from the nose 
throat, and faeces. This organism 
had not been isolated in routine 
hospital cultures or in cultures of 
pathological specimens for several 
months before the outbreak. In addi- 
tion, no recent staphy lococc-al infec- 
tion had been observed in the patients' 
families or in the community. 



Correct Answers,' Annotations- 
and References 



Ans b) Boric acid solution, which is 
used to sterilize diapers, is known to 
caust- toxic epidermal necrolysis. Other 
causoa include staphylococcal disease 
such drugs as penicillin, sulfonamides 



Leiner's Disease which 



may 



hydantoins 

present in a similar fashion-, seems to 
be a generalized form of seborrheic der- 
matitis. This disease is extremely rare 
and usually presents between 2-4 months 
of age._ It is important to different 
tiate Ritter's Disease from boric acid 
poisoning. Usually the staphylococcus 



The cause of the outbreak was most 
probab ly : 

a) Staphylococcal epidermal Necro- 
lysis (Ritter 's Disease) 
Boric acid poisoning 

c) Nitrite poisoning 

d) Streptococcus Group B outbreak 



m Ritter's Disease appears somewhere else 
in the hospital before the fullblown case 
in the nursery, and other members of the 
family usually harbor the particular 
staphylococcus strain. Only because of 
the absence of this feature did the- authors 
of the report investigate other possible 
etiologies to the epidemic epidermal 
necrolysis and found it to be boric acid 
poisoning in which a solution of 3% boric 
acid was substituted for distilled water 
m the formula preparation, 

Ref. Epidemic boric acid poisoning 
simulating staphylococcal epidermal 
necrolysis of the newborn infant- 
Ritter's Disease. J. of Ped. 77:884 1970 



Toxic Epidermal Necrolysis (LyeU] the 
Scalded Skin syndrome. Amer. J 
57: 140, 1964 



Med 




Textbook of Dermatology 
Wilkinson F.A. Davis Co 

PP 123, 133, 1192. 



Rook 
Phil 



•and 
1968 



Sample Se 1 f - As s . men t Question^; 
Journal (please type) The J ournal of Pediatrics 



^""'"''^ ""^"^ _iiiyii£iH.2£££^£t^^ care 



Sunior Author; Robert H. Dranhman 



Pub lication Date Nov. 1970 

the lefthand column; correct answerr «nnJ ?• " should appear in 

in the righthand coiumn. Indicate^hether references shoufd appear 

goneralist^applicable. or applLable tobo^h" is speci a 1 i s t -appl i Lb i e 

"SG.. in the margin to'the laf of ach quesJifr^^^'r ^ "S"- "" or ' 

Boston, Mass. 0221S. ~ question. Return to PMI, 30 The Fenway. 




3 After careful study, it has been shown 
, that a pediatricians time may be saved 
3'jy what percentage by an assistant 

carrying out tasks formerly performed 

by the pediatrician 

i 

\A) 10% 
B) 30% 
i :) 50% 



Correct Answers| Annotations-, 
and References 



Many workers in the field of health 
.cere organization a-^d delivery recog^ 
I ize that this country is in state 
Jt "health crisis". Because of i„= 
creased demand for health services 
mportant considerations must be given 
n the future to help solve this healt 
crises to 



) 



insuran ce 
num income 
number of 



specia 



National health 
Guaranteed mini 
Increase in the 
lists 

Increase overall health care pro- 
ductivity in a more efficient and 
efrective manner by increase in the 
number of allied health workers to 
do many tasks that physicians are 
doing now. 



S?ates-with''"''',P"'"'" ^" ^J^^ ^"it^d 
btates with special attention to the 

vices Yankauer et al . 
Pediatrics 45:521, 1970. 

fLiL'"''^"i"« *° ""^ in study 

CBergman et al Time Motion study of prac= 
ticing pediatricians ' - 

Pediatrics 38:254. 1966) only 46% of a 
practicxng pediatricians time was spent 
with of f 1 ce patients , 

oower^k/^''^' P"°^^^^ the purchasing 
power tor people who cannot afford healfh 

the ah-^ .""*""""^'^1>'' if one has 

the ability to pay for health services 
they are often times not available and' ■ 
accessible. Increasing the number of 
specialists only magnifies the unavail- 
nbiUty of family practitioners, or 
generalists in pediatrics and internal 
i^edicme New approaches to increasing 
the productivity of medical care by Sng 

be succ'^'fl '''' ^''^ Shown to ' 

De successful m manv ^^^a^ 

be .lly evaluated - ' ""^^ ^° 

cfrf* n^^'^"^" Productivity and Medical 
Care, Drachman and Cooke 
J,of Pediatrics 77.-749.l970 



ERIC 



Journal (please type) ^ _ The J_ournal of Pediatrics 
Article Title 



Physician Produe., 



^J-ty and Medical Care 




Senior Author 



In the space below please ty 



the lefthand column; correct answ.rr ^ and answer choices should arnoar in 
in the ri.hthand coiu„. Ind t "herrrnu=":t°"' — " should^^pp L 

«enorai....,ppacabie. appUca.ie Jo bj'h oup^ hTp^ufiir a^^i^ ^ - ' 



'SG* 

Boston^ Mass, 0221S 



in the margin to the left f oach question 



or 



Return to PMI, 30 The Fenway, 



Questions* Answer Choices; 
6 S, G, SG Designation 



Atter c.reful study, it has been shown 
that a pediatricians time may be saved 
oy what percentage by an assistant 
carrying out tasks formerly performed 
oy the pediatrician 



A3 



10% 
30% 
50% 



^Many workers in the field of health 
^f!"! ffsanization and delivery recog 

country is in a state 



ize that this 



iJf "health crisis". Because of in= 
creased demand for health services 
j mpcrtant considerations must be given 
in the future to help solve this healtl 
crisesto 



National health insurance 
Guaranteed minimum income 
Increase in the number of specia= 
lists 

Increase overall health care pro- 
ductivity in a more efficient and 
effective manner by increase in the 
number of allied health workers to 
do many tasks that physicians are 
d o 1 n g n o w . 



Correct Answers? Annotation: 
and References 

Statef Wtf^'^-'''' practice in the United 
itates with special attention to thr^ 

vfc s'?aT °' '"'^''^ ^""^ - — 

vicos lankauer et al. - 

Pediatrics 4S-S21, 1970. 

It is interesting to note that in one study 

CBergman et al Time Motion study of prac^ ^ 

ticmg pediatricia^^ ^ 

Pediatrics 3S:2S4. 1366} only 46% of a 

practicing Ded^qtT■^^4a 

Peaiatricians time was spent 
with office patients. " 

Ans. D) A3and B) provide the purchasina 
power tor people who cannot afford h"a?fh 
.are but unfortunately, even if onrhas 
the ability to pay for health services 
they are often times not available and' 
accessible. Increasing the number of 

biulv'of%°"'^ the unavail = 

ability of family practitioners, or 
generalists in pediatrics and internal 

Jof Pediatrics 77.-749.i97o 



^/H^j .cervical (Jvtoio gy and seq ue ntial Birth Control Pills 
Article Title Obstetrics and Gvnficoloprv 



Senior ,\uthor; Dougherty, nary ' M, 



Pub 1 i cation Date Nov. JHTO 



In the space below please type multiple choice auo^tin^. , 

from tho article listed Questions and t u answers generated 

the icfthand column; corro ct ' answers anL tali ''d 1 

in the righthand column. Indicate whether a nun^. references should appear 
gcneraust^appu.able.or appUcabLlfSoL^^ou r^pu^^^rJ^^S^^ 



Questions; Answer Choices; 
G , SG Des i gnation 



6 S 



S+G 
1) 



Prolonging the eKposure time of a 
patient to the birth control pUl 
increases the risk of developing 
abnormal cervical c3^ology smears. 



True or False: 



Answer: FALSE 



S+G 
2) 



The use of sequential birth control 
pill results in increased numbers of 
breast con cer. This explains why 
one leading brand is no longer 
available. 



True or False.' 
Answerr FALSE 



S4G 
3) 



Use of the pill has in fact been shown 
to reduce the incidence of cancer of 
the cervix by improving the health 
of the cervical epithelium. 



True or False' 
Answer: "E-iLSE 



S 

4). 




Cytologic Atypical and positive 
smears are found about twice as 
frequently in the pill patient popula- 
tion as in roughly comparable 
untreated women 



Correct Answers; Annotations* 
and References 



Prolonged exposure to the pill does not 
increase the risk. Since rate of occurrence 
is a straight line level function of length of 
treatment. This was borne out by rulings 
of F, D. A. when restrictions were removed 
on the length of time a patient could take the 
birth control pilL 



There is no evide.ice to show thai the pill 
causes cancer of breast or cerviK. There 
was an increased pregnancy rate with the 
sequential tj^pe as compared to the combined 
pilL It has nothing to do with contlmied 
unopposed estrogen the sequential pilL 



The pills do not protect against cancer 



According to Dougherty, C. (Cervical 
Cytology and Sequential Birth Control 
PiUs VV36 No, 5, Nov, 1970) His patient s 
from New Orleans, predominently black 
and from lowest social economic stratum 



i Sample Self-Assessment Questions 

. Journal (please type) OBSTETRICS AND GYNECOLOGY 
^'Article Title 



Page 2. Sect. A, 



X-ervlc^l Cytolopy and Sequential Birth Control Ptlls 



Senior Author 



Dougherty. Gary M, 



J 



Publ ication Date Nov. 1970 



In the space below please type niultiple chDica questions ^nH .r..,. 

from tho article listod ab^ Questions anil answe/cLicfs sh^ generated 

the Icfthand coluinn; correct answers annotatinnf !L J should appear m 

goneralist^applicable. or applicable to both g^ouprbrpu t " ' " ^ 

bG" m the margin to the loft of each question. Return to 30 'th' p" 

Boston, Mass. 02215. ^^Luin zo imi^ 30 The Fenway, 



Questions; Answer Choicer; 
6 G, SG Designation 



continuatiori/. , 
4) 

True or False 
Answer* TRUE 



Correct Answers^ Annotations* 
and References 



would be expected to have tncreased 
frequency of coitus and ino^eased vaginitis 
which would be expected to increase 
abnormal cytology. 

REF: Watt. L. and Jennlson F. 
Incidence of Trichomonas Vaginalis in 
Marital Partners, Br. J. Vener Dis 
36: 163-166 1960 

Rawls, E,, Tompkins, A, F, , Ftgueroa E. 
and Melnlck J, L. , Herpesvirus Type 2 
Association with Carcinoma of the Cervix 
Science 161: 1255- Sept 1968 

Koss, L, G/ and Wolinska W. H, 
Trichomonas Vaginalis Cervicitis and its 
relationship to cervical Gancer, 
Cancer 12: 1171 - Nov. Dec. 1959 



FRir 



Samplo Sel f-ABsessment Quosti 
Journfil (ploase- type) OBSTET RICS k GYNECOL OGY 

Application of the ^ ' ~^ ~ 



ons 



Page 1 Sect. B. 



Article Titlo 



)b5tetric Forceps 



Senior Author: Mines, Julian Lanstng 



Publication Date ^' o^- 1070 
In the space below please ty^o multiple choice questions 

trom the article listed ab^Ti^ Questions anH --°"f answers gonerated 

the lefthand colu„; correct a„sl"r ^L alien "L ^.'J"' ''""f 

the rishthand column. Indicate wlUth a ffjue , i^^^ Wear 
ganarau.t^ap^ " applicable to both g?ouprhrpu t I" 

SG in the margin to the left of each aue^tinn d I P""^^S a S , n^^n 
Boston, Mass. 0221S. . " " question, Ruturn to PMI ^ 30 The Fenway, 



Questions* Answer Choices 
ft S, G, SG Designation 



1) 



The full term fetus ia utero exists 
in such equiibrium that the maternal 
venous blood contai s the same 02 
saturation as does the fetal arterial 
blood. 



True or False' 
Answer: FALSE 



G&S 
2) 



In using obstetrical forceps the 
degree of cranial compression 
created is proportionate to the force 
of traction employed 



r^ue or False: 



Inswer: TRUE 



0 



To safeguard the baby and to protect 
the maternal soft parts the operator 
should brace his feet against the 
table so that he will not slip and 
possibly harm his patients during 



FRir 



the delivery 



Correct Answers? Annotations 
and Refarences 



Actually the full term fetus exists in a state 
of cyanosis, comparable to that found in a 
patleat on top of Mount Everest. Eastman 
has described the state as "Mount Everest 
in Utero-'. This cyanosis exists with a 
degree of blood oxygen^unsaturation twice 
that necessary to cause visible cyanosis. 
During a contraction fetal arterial blood 
contains less oxygen than does venous blood. 

REP: Munro D, Cranio - Cerebral Injuiy 
in New Born. ^ Oxford Medicine Vo/e 
New York, Oxford University Press 
1949-6=136 

More fetal embarrassment results from 
excessive compression of the vertex than 
from any other effect produced by the use 
of forceps. 



One should never brace his feet. If this 
much force is required the forceps 
operation Is not indicated and will probably 
damage mother and baby 



I Samplo Self-Assessmont Questio ns 

Journal Cplease type) OBSTETRICS & GYNECOLOnv 



Page 2 



I 

I 



Sect. B 



Article Title Application of the Obstetric Foi-ceps 



Senior Author: Mines. Julian Lanstnp 



Publication Date Nov, 1970 



In the space below please type multiple choice niiP <: 1 1 r>r,= ^ a 

from the article listed abifir Questions and answ rcLicf/^hou^d 8°"^^^*^^ 

the lefthand column- correct answers, annotat i ons and rcf o^Lc'r hou^f" 

m the righthand column. Indicate whether i oun^ti^n should appear 

geno.ans -appUcabU, or appIicabl/Jo^\"h%;o 'bTpi^inTr-s^-Jlo^K'i^"'''^' 



Questions; Answer Choices; 
6 Sj G, SG Designation 



4) 



Abuse of Obstetrical Forceps may 
cause distortion and angulation of 
the cerebral veins great enough 
to impair the venous drainage of a 
portion of the brain. 



These events may cause: 
True or Falser 

(a) Increase In cerebral venous 
pressure 

TRUE 

(b) Cerebral venous pressure 
increase causes Intracranial 
pressure to fall, 

FALSE 

(c) Brain damage may result from 
the vascular congestion and 
its sequelae. 

TRUE 



lERiC 



Correct Answers' Annotations' 
and References 



Increased venous pressure in cerebrum 
causes intra cranial pressure to rise further 
thus creating a vicious cvcle 



Cortical and subcortical thromboses and 
hemorrhage may well follow, Forcnps 
are capable of great potential damage if 
injudiciously used. 



REF: Holland E, 

Cranial stress in foetus during labour and 
effects of excessive stress on intracranial 
contents, T. Obstet. Gynaec. 
/Brit. Comm. 20; 549-571 1922 



Sample Self-Assessment Question. 



Journal (please type)_OBSTETRICS & GYNECOLOGY Paf e 1 

I ~~ ~" ' ' Section C 



Article Title Hvperth yr ni ri t sm During Prefrnflnf^v 



""''"^-JlatbSCLLJV^^ -.- Ucatlon 1970 

, In the space below please tvpe multinie choirs n,,.^- 

(from the article listed aboTtr Questions and L "u answers generated 

ithc lefthand column- correct answers annotatif i'^^"' ^PP«^- 

in the righthand colu.n. I ndi ca t ^wh o "eff ue , i ^ns 'i ^ ^P^"^ 

J m tn,e margin to the Inft of r-^nh a,...^*-^ puuuing a b , "G" or 

Boston. Mass. 02215. question. Return to PMI . 30 The Fenway, 



Questionsi Answer C^qices; 
6 S, G, SG Designation 



G. 

1) Thyrotoxicosis In the piegnant 

patient can be safely treated with 
radio-active Iodine since this drug 
does not cross the placenta 



True or Falser 



SE 



2) 



In treating Hyperthyroidism during 
pregnancy, a cardinal principle is 
to treat the mother and ignore the 
fetus since the maternal thyroid 
acts as a pacemaker for fetal thyroid 
hormones* 



True or False: 
Answer: FALSE 



S+G 



3) 



Treatment of pregnant patient with 
thi©urocil drugs has resulted In 
fewer cretins and others with fetal 
damage than the patient treated with 
subtotal thyrotdectomy after brief 
preparation with anti-thyroid drug. 



True or False: 
^n Q FALSE 

ERLC 



Correct Answers^ Annotations^ 
and Rsf erences 



Radioactive Iodine crosses the placenta and 
is contraindicated during pregnancy. The 
fetal thyroid takes up radioactive Iodine 
after 12 weeks of gestation, 



Maintenance of maternal euthyroidism by 
either exogenous or endogenous thyroid 
hormone may not provide sufficient thyroid 
hormones to the fetus to assure optimal 
development, if fetal thyroid is compromised 
by drugs therapy. 

BEF: Hyperthyroidism during pregnancy 
Talbert et all OBST & Gynec 
V. 36 #5, November 1970 



Retardation or cretinism In surgically 
treated patients Is extremely rare in 
contrast to the many reports of permanent 
damage in the fetus treated with thiouracll 
drugs over a prolonged period of time. 

REFi HerbstA, L, , Selenkow, A. 
Hyperthyroidism during pregnancv New Em 
J. Med. 273:627 1965 



Sample Self-Assessment Quostions 
i Journal (ploaso typo) OBSTKTRrrcL^jmJECOLOG Y 

Article TLtIo HYPERTHYROIPl SM nTTRTNn PRT^n^ANTny 



Page 2. Sect. C. 



Senior Author: Talbert, Thomas, Holt and Rankin 



Publication Date ^^^0 



? In the space below ploase type multiplo choice auestinn^ -.^i 

from the article listed abovf^ Cues t i nn^^n ^ answers gonorated 

the lofthand column; corre 't " answer J nnLt^f • . ''^ °^ '^^""'^ "PP«^r in 

I in the righthand CO umr iLica^f whether ^-^f^^ences should appoar 

^ «-r-^--PP^i-^l- - ^PPlicabJe1r^oth%?ouprhrputti^^ 



Questions* Answer Choices; 
5 G, SG Designation 



Correct Answersi Annotationss 
and Rofercnccs 



4) There is a marked decrease in 

thyroid binding globulin in pregnancy, 
which is due to increasing pro- 
gesteroi e levels 

True or False 
Answer: FALSE 



Thyroid Binding Globulin Increases in the 
pregnant patient most likely from a ride 
in estrogen production. 



REF: Man et Al 
Thyroid function in hum 
J* Obstet. Gynec 
103:338 1969 



an pregnancy 



EKLC 



Sample So 1 f -As s n^smcn^ Quest i ons 
Journal (please type) OBSTETRICS & GYNECOLOGY ^'g^ 1 Sect. D 



Article Title _Endometrical HvDerplaHiflJn^^^nun^ 



Senior Author: 



in the space below plcane tvne mu 1 f i n 1 ^k^^ ^' 
fro. the article lilto, ,,^ s onJ ^nd ?n::^'""H senorated 

the icfthand column; correct answers a"not"tio^ %"'°;-"' ^I'P^^'^ in 

m the righthand column. Indicate whether a 'u^ t''"' rotoren.o« .hould appear 

«oneranst-applieabl.. or applicable t fbo th gSoSp^bf J ^ J f * -PP -^i^ 1 o . 

iC. in the margin to the loft of each question n t P"*^'"R " or 

Boston. Mass. U221S. qu.fation. Return to PMI , 30 The Fenway. 



Questions; Answer Choicos 
^1 S , G , SG Designation 



Correct Answers? Annotations* 
and References 



S+G 



1) 



A 24 year old female has a long 
history of amenorhea interspersed 
with bouts of profuse uterine bleeding 
The most appropriate initial treat- 
ment is:- 



(a) 

(b) 

(c) 
(d) 



treat her with Birth Control 
pills to regulate her cycles 

give her corticosteroid therEpy 
to check her adre lal glands 

D. & C. 

give progesterono injections 
which will cause a medical I 
curettago. 



iVer: 



(c) 



The younger infertile female who has 
associated findings of adenomatous 
hyperplasia of endometrium is most 
like.iy to conceive. ■ 



(a) 
(b) 



shortly after the Initial DkC 

after a short cause of estrogen 
priming and progesterone 
cycling. 



(c) 

Perform D & C or Endometrial Biopsy to 
establish a diagnosis. If the patient show^ 
adenomatous hyperplasia there is a greater 
incidence of adenocarcinoma of the 
endometrium. 

In the paper by Chamlian and Taylor Obst& 
Gynee V. 36 #5. Nov. 1970 14% of their 
patients developed adenocarcinoma of the 
endometrium up to 14 years after initial 
diagnosis was made. 



(d) 



The overall results in patients with adenoma- 
tous hyporplasta is discouraging. 



In Chamlian's study only 27% conceived after 
diagnosis of Endometrial hyperplasia was 
made there were only 21% of the pattent.ci 
who carried to term. 



o a nip i g a G 1 I - ji\ h h u b h iiiy n t uu c S t i una 

^ ~ ^ — — — - - " " Page 2. 

Journal (pluasc typo) O BSTETRICS GYNECOLOGY 

ArtlcJo Title Endometincal Hyperplasia in young women 



Sect, D, 



Senior Author: 



and Ta ylor H, B. 



_P u b I i c a t i o n Date 1070 



In tne space below plDase ty^o umltiplo eholco questions and answers generated 
rom the article nstod above. Question, and answer choices should appear n 
the Icfthand column; correct answers, annotations and r e f c r e nee s s h ou Id app e a r 
in the righthand colunin. Indicatu whether a questions i« s pec i a 1 i s t = .nn i i ^ e 
generalrst-appUeable, or applicable to both groups by putting a^^S^ appli...!., 
^iC, in the margin to the left of each question. Return to PMI , ^0 'iho Fenway 
Boston, Mass. 02215. ^rnuay^ 



Quostions: Answer Choices; 
Sj SG Designation 



Correct Answers* Annotations* 
and References 



continuation:. * 

2) (c) after a short course of non 
sequential birth control p^' Is 

(d) after induction of ovulation 
with clomiphene or wedge 
resection 

(d) 



Ovulation Induction appRai^s to offer the best 
results: 50% of the patientB conceLved and 
none has developed adenonarcinoma to date. 



Answer: 
S 



Answer: 



Young women with cystic (Swiss 
cheese endometrium) havci the 
following: 

(a) an elevated 17 Keto-Steriod 
level 

(d) Sclerocystic ovaiies in a high 
percentage of cases 

(c) a considerable risk of 
developing carcinoma of the 
endometrium 

(d) ' None of the above 
(d) 



(d) 

Cystic hyperplasia is a benign condition 
as contrastod with atypical or adenomatous 
hyperplasia which runs a gamut of events 
leading from anovulation to endometrical 
hyperplasia or carcinoma 



EKLC 



Sample Sol f-Agsessment Questions 
Journal (please type) OBSTETRICS & GYNECOLOnv 



Paga 3. 



Sect. D. 



ArticJe Title Endome trical Hyperplasia In vouiT^wnm^n 



Senior Author: Chamlian D. and Thylor H. B. 



Public ation Date 1070 



from'^H niultiplo choico questions and answers venerated 

llr ^^t>^''V^^ Questions and answer choices should appear in 

the Icfthanci column; correct answurs ntnt\nn^ i ^-J-H^^^r m 

in the righthan. co,u,nn. Indicate wli c t. . . t " 1%^;" ^ n ' : fJ^M - 

Boaeralxst-applicablc, or applicable to both groups by pui t i L^a " " " ' 

..oS.o " lltrilnV °' ««ur„ to ^M,, 30'ri,o .ay, 



Questions' Answer Choices; 
S SG Dosignation 



Correct Answers i Annotat i on5; • 
and References 



4) The diabetic obese young woman with 
adenomatous hyperplasia can avoid 
problems of infertility and future 
development of adenocarcinoma by 
' cdhtrolling diabetes and obesity 

True or False 
Answer: FALSE 



Nelgher treating the hirsuitism nor control- 
ling the diabetes and obesity has iiiuch 
influence on infertility or f "ture carcinoma 
developme it. 

The best treatment is to induce ovulation. 



ERIC 



Journal (please type) 

Article Title C ENTRAL VENOUS PRE SSURE IN SUPINE POSITION DURING 



NORMAL PREGNANCY 



Senior A u t fi o r 



Coldlt^ R, R, , .Tnany W. 



Publication Date 



th c 
i. n 



In the space below pjoase type multipla choice auestion^ 

from the article Usted Questions and an^ r choic'.'shou^d S""""^'^ 

etthand colu.n; correct answers, annotations "d Jeferen'Ss s^ouir" 
the nghthnnd column. Indicate whether a questions i J , appear 

«.neraUst^appUcable, or appUcable to ,oth gJou rrpittl^ra^^^S^'^f^fi^^^ 
Boston: M^L:"125i5° °' '''' -^"^ ^ . 0 or 



The Fenway, 



Questions; Answer Choicos] 
5 S, G, SG Designation 



S+C 



i) 



During Pregnancy the following 



L.rrect Answers^ Annotations*, 
and References 



physiologic changes occurs 
True Or False: 

(a) There Is decreased pressure 
on inferior Vena Cava 

FALSE: 

(b) There is increased Cardiac 
output 

FALSE. ^ 



2) During Pregnancy the following 
changes occurs 

True or False: 

(a) There is an Increase in Central 
Venous Pressure with advanc- 
ing pregnancy 



(a) There is Increased pressure because 
of weight of the uterus and its contents 



(b) There is decreased'cardiac output 



FALSE. 



S+G 



(a) There is a decrease in central venous 
pressure with advancing pregnancy 



V Durti.g la^or the most physiological 

position is for the patient to lie on 
her back 

True or False: 

ERiC^ALSE 



The worst position for the patient is to lie 
on her back since the weight of the uterus 
on the inferior vena cava resiilts in pooling 
of blood in ihe lower e^rtremeties and venous 
return to heart is decreased with resulting 
hypotension which is reflected to the fetus. 

continued/. * . . 



Sample Sel f -As s os sment Questir,ti. 



Journal (ploasc type) 



Page 2. Section E. 



Article Title CENTRAL VENOUS PRESSURE IN SU PINE POSITION DURING 
NORMAL PREGNANCY ' 



Senior Author; 



Publ i cation D a t e 



In the space below please type multiple choire nn^^ct-i^^ i 

fron, the article listed aboitT Question, and an'wer "h " ^"f""' generated 
the lofthand column; correct ans wors , anno^at i o" "d Icf °"'f 
in the rightha.nd column. Indicate whether a aue^tfn "f^^''"^" should appear 
fieneraUst-appllcabla. or applicable ^^b^th^^o™ put t^S^ 



Questions^ Answer Choices 
SG Designation 



J) continued/, 



Correct Answers; Annotations* 
and References 



1) 



The use of the central venous pressure 
in Interpreting hypovolemic shock 
becomes most valuable in bleeding 
problems In the third trimester the 
patient should be transfused if central 
venous pressure Is lower than 5 c m 
of H20 



This is well demonstrated by fetal heart rate 
patterns. 



The average central venous pressure in the 
third trimester averaged 3.8 c. m. Therefore 
the central venous pressure as an indloator 
must be balanced for transfusion hy the 
overall clinical picture 



BEF 



'rue or Fa^lse 



FALSE 



Central venous Pressure in Supine 
position during normal Pregnancy. 
Colditz, , and Josey W. E. 

Obst. and Gynec V. 36 No. 5 
November 1970 



Journal (please type) 



ArtlcJe Title 



Obstetric and qyn.rnl nMc^cons lderati ons of dwarfism 



Senior Author:, John E T.... 



in the space below please 
from the article listed above" 
the Icfthand colunin- correct 
in the righthand column 



^Publication Daten /l^/n 



- - , ind c":\',;.rrr'°"' m "p 

I3oston, Mass. 0221S. " " question. Return to PMI . 30 The Fenway, 



Questions; Answer Choices 
§ S, G, SG Uesignation 



: Normally proportioned dwarfs are 
referred to asateiiotic and the 
rajonty have an Isolated deficiency of 
J rowth hormone. These patients exhibit 
all but one of the followim: 

Abnormalities of insulin 

secretion . 
Hypercholesterolemia 
Hypertrlgiycerideniia 
Sexual rfiaturation is delayed 
Diabetic retinopathy 

' ssignation : S, SG and G 



Correct Answers,' Annotations 
and References 



b 

c 

d, 
e . 



E 

J, 



D. (1970), 



D. 
J. 



;i970 ), 

Marl iss 



Hall ,J 
Clin. 



t 
I 

■ The single most important objective 
ftf prenatal care 1n a dwarf pregnancy is 
Lipid homeostasis 
Prevention of qlycosuri 
Prevention of megaloblastic 
anemia 



a , 
b, 
c . 



e. Prevention of tetany 



)es 



*5~*1on 



ERIC 



Sf SG and G 



Answer ■■ E 

^nnomi^n: Growth hormone influences 
the intermediary metabolism of protein 
carbohydrate and lipids. Diabetic 
retinopathy is not encountered in! the 
Ipt H although microangiopathic 

lesions do occur in hemochromatosis and 
other entities where carbohydrate 
intolerance is observed. 

References • 

Merimee , T. J . , Fi neberg S 
McKusIck, V.A. and Hall , 
J . C1 1 n . Invest . £9.-1096 
Mirimee, T. J. , Sipersteln, 
and Fineberg , S. E. 
Invest. 41:2161. 
Merimee, T.J. , Felig, p 
Fineberg, S.E. and Cahill , 
J. Clin. Invest. 50_:5 74. 

Barnes, A. C, McKusick, V.A., 
acout, C.I. and Jones, G.S. (1970 
Am. J. Obstet. Gynec. 108:688. 
Zierler, K.L. (1 968 ), InT-Clinical 
Endocrinology. E.B. Astwood and 
C.E. Cassidy, Editors. Volume II, 
Amsterdam, p. 55. 

Answer: D 

Severe degrees of ky^oscceiosi s 
serious cardiopulmonary 

i^i'imtnmMlT^^^'^^ Of 

Referents? considered. 



G.G. (1971), 



Annotati on 
commonly result in 

problems with 
compl 1 - ■ ^ 



citTonv m mmi' 



Bender, 
Jones , 

Mendel son , 

56:457. 
Tyson , J. E. , 

Scott, C.I 

.1. nhcl-et 



S (1965], Brit 
D.H.(l964j, Lancet 



C.L, 



J.Med 
, , cet 1 

(1948), Am. J, 



2:1166. 

517. 

Obstet . Gynec 



Barnes, A.C. , McKusick, V.A. 
■ and Jones , G. E. ( i970 ] . Am 



Journal (please type) 



— ^Mmnc^^mlj^McoloHic^^ dwarfism 



Senior Author: John E. Tyson 

— — — Publication nat e n/1/70 

In the space below nleflqe tvoe mu i t i n i ^ r-h^- 

from the articlo iistod'nblTf^ Q^cs LnJ ani 2^'"°"^ '^'^^^"^ generated 

the lefthancl column; .orre = t answeL aL'otatian'"'% ''^""'^ ^PP°" i« 

in the righthand column. I nd i ca t rwhet? ef f ""^ t i ons ' '^ ' - ' 

generalist-applicable, or app l i cab 1 e t o b a^h . u spec i a 1 1 s t -appl i cab 1 e . 
"SG- in the margin to the 1 ef t of each au^. t ■ ^ ^'n''^ putting a "S", "g- or 

Boston, Mass. 02215 question. Return to PMI , 30 The Fenway 



Questions; Answer Choices; 
5 S, G, SG Designation 



I One of the following is true 
concprning achondroplasia: 

i a. it is the least common variety 
1 of disproportionate dwarfism. 

b. It is transmitted as an 
, autosomal recessive. 

} c. Commonly associated with cleft 
palate. 

d. Associated with advanced paternal 
age. 

• e. Frequently associated with hyper- 
extension of the elbows. 

I; 'Siqnation ; S, SG and G 



In the etiology of dwarfism one 
ould consider all but one of the 
11 owing: 

Nutritional deficiencies 
Endocrine Imbalance 
Emotional stress 
Neurofibromatosis 
Congenital heart disease 



a 
b, 
c , 
d. 
e . 



Clsignation: S, SG and G 




Correct Answers,' Annotations-, 
and References 

Answer D, 

Annotati on : Achondroplasia is the 
commonest variety of disproportionate 
dwarfism and Is transmitted as an 
autosomal dominant. In addition to 
exaggerated lumbar lordosis, bowing of 
the legs, limited extension of the 
elbows, It has been shown that advanced 
paternal age is a factor. 

References ■ 

Murdock , J . L. , Walker, B 

Abbey, H. , Smith , K. K, 

V.A. (1 969 ), Ann. Hum. 
Tyson , J. E. , Barnes , A. C 

Scott , C.I. and Jones , 

Am. J. Obstet, Gynec 

Answer D. 

Annotation: The differential diagnosis 
of excessively short stature should 
commence with a consideration of those 
bone, nutritional and circulatory 
disorders which one associates with 
skeletal abnormalities; chondrodystrophy, 
rickets, osteogenesis Imperfecta, 
tuberculosis of the spine, celiac disease 
cystic fibrosis, chronic nephritis, 
hepatic disease, congenital heart disease 
and bronchiectasis. This statement 
pertains parfi cu 1 arl y to the adolescent. 
References : 



A. , Hall , J.G. , 
and McKusick, 
Genet. 33: 227. 
, McKusIck, V.A. 
G.S. (1970), 
108:688. 



Brasel, J. A. and Blizzard 



Howel 1 , G. F. 

R.M. (1967), New Eng. J. Med. 276il271 
Tanner, J.M. (1 962 ). Growth at^mol Escenae 

Blackwell Scientific Publications, 

Oxford , pp. 638. 
Tyson, J.E., Barnes, A.C., McKusick, C.'A., 

Scott, C.I. and Jones, G.S. (1970), 

Am. J. Obstet. Gynec. 108:688. 
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Article TUU „ Renal he.odyna.1r P j£&m.jiI.Mlto_eijLJiL_aate^ 



_and p ostparta] womsn 



Senior Author: Robert A. Munsick 



Pu b 1 i c a t i o n p a t e 11 / 1 / 7 0 



In the space below please type multiplo choice questions ^nH . 
from the article listod aboTT^ Questions ^nH C answers generated 

the lofthand column; correct answer anL^^tion ^nd'r'f'"' ^PP«^^ 

in the righthand column. Indicate wl e tJ e r ' a ue s t ?^ " " ^PP«^' 

^s2""n1h^T''^^'^^' " appUcable t f ^ ^^h ^ o^ rh^pit t i ^ S ^ " ^^^^ ^ jf^ ^ ^ ' 
Boston? Mass^"?2"J: = ' ^""^ ^o%t , 30 'tHo FeLay, 



Questions- Answer Choices 
6 S, G, SG Designation 



pe ri oc 



A healthy 25-year-old patient with 
i an intrauterine fetal demise due to 
erythroblastosis .fetalis at 34 weeks 
igestation is admitted to hospital for 
I induction of labor. After the InfusioH 
of 240 i.u. of oxytocin In 9 liters of 
5 percent dextrose in water in a 
of 12 hours, the patient has a 
convulsion and is comatose. The most 
likely diagnosis is: 

Eel amps i a 
Epilepsy 

Amniotic fluid embolus 
Water intoxication 
Diabetic coma 



Correct Answers,- Annotations-, 
and References 



a 
b 
c , 
d, 
e . 



Ans we r 



Designation : S, SG, G 



It is considered that the major 
mechanism involved In oxytocin-provokec 
j intidiuresis is a direct Pharmacol oqic 
^ if feet on: 



Annotation; This case outlines the 
pathogenesis of an iatrogenic entity due 
to the massive infusion of electrolyte 
free fluid with oxytocin which has anti- 
diuretic properties. The correct 
treatment is the infusion of 3 percent 
saline at the rate of 50 mis per hour. 

References : 

^"n-aJ;--^u° = ''^S'^' Whitener,D.L. 
(1 969 ) , Obstet. Gynec. 34:212 

Lilien, A. A. (1968), ObstiT. Gynec. 32:171 

Munsick, R.A. and Gresham, E.M (1970T 

Am. J. Obstet. Gynec. 108:729. 

(1966), 



Saunders, W.G. and MunsickTR-A. 



Am 



J. Obstet. Gynec. 95:5 



a 
b 
c , 
d. 
e . 



Glomerular filtration rate 
Renal plasma flow 
Descending loop of henle 
Efferent glomerular arterioles 
Distal convoluted tubule and 
collecting ducts. 



j Answer : 



E ■ 



Designation 



Annotation: Renal clearance studies 
using inul in, para-ami noh1 ppurate , 
creatinine as well as urine flow rates, 
osmolar clearances and free water 
clearances in 12 antepartum and 14 post- 
partum hydrated subjects during oxytocin 
infusion were reported by Munsick and 
Gresham (1970). The antidiuretic effect 
of the oxytocin was found to be due to 
water absorption from the renal distal 
convoluted tubules and collecting ducts. 

References : 

Munsick, R.A, 
93:442. 

Munsick. R.A. and Gresham, E.M. (1970) 
Am. J. Obstet. Gynec. 108:725. 



(1965), Am. J. Obstet. Gynec 



Samp I G Sel f-AssossniGnt Quest i nn^ 



|/ournal (please type) 

'''''' — fi^^2ai_Mi]iMm^ 



^erican Jour nar _of Obstetrics anH_^ /n^7^ 



and post part a1 women 



Senior Author: Robert A 



_Munsi ck 



Publication Date n /1/7n 



|in the space he]u^ please type niultiple choice aucstinn^ 
trom the article listed abo^T^ Questions ^nd an.w , answers generated 

the lofthand column; correct answers anLt.tion .nl i"' ^I'P^" 
■n the .ighthand column. Indicate whet^err °" t^ns ? "'e^ ^^^^^ 
Warai.st-applicablo, or applicable to both grouj^by^itt ^r^'s" J^P'o'''''' 
.n the mar«xn to .ho loft oi each question, ReL^n t^M , o 'rhe F:nway 



'Oston, Mass 



0221 S 



Questions' Answer Choices; 
fi S, G, SG Uesignation 



5 Studies have shown that the dose 
oxytocin administered by Infusion 
relationship to the anti- 
effect of the drug/ 



of 



bears . no 
H ureti c 



Answer: False 



Designation : S, SG 



Correct Answers^ Annotations* 
and References 



Annotation- Profound antidiuresis occurs 
when oxytocin is administered at the ratP 
of 100 mu per minute but is further 
increased when the drug is administered 
at the rate of 1000 mu per minute. On 
the other hand, the antidiuretic effect 
IS much less when the infusion is at the 
rate of 20 mu per minute. 



Am, 



References : 

Munsick , T. A. (1 965 ), 

Gynec. |2:442. 
Munsick, R.A. and Gresham, E.M 

Am. J. Obstet. Gynec. 108:725 



Obstet. 
(1970), 



ERIC 



Sample Self-Assessment Questin 



ons 



Journal (please type) 

i " " — 

Article Title Cardiovascular Effect, nf 



lean Journal o^ Jbstetries and ^yn e^rnn^ 
Oxytocia! n>^iiqs uspri p^e^ p 



axium. 



" Senior Author 



i In the 



Charles H. Hendricks, M.D^ 




tho Icfthand column- corr»-f ana answer choices should 

in thcrighthand co;„„„""^-;5dic:rr:hoth:r°"°"-^ "f"-"^ 



appear in 
should appear 

generalist-applicable, or applicrble%'rhof\" ''""^"^u"^ s pec i al i s t -appl i cab 1 e . 
;;SG.. in the margin to'the ef ofoLh question "''fi'^ ' °^ 

Boston, Mass. 0221S. question. Return to PMI 



30 The Fenufay, 



Questions- Answer Choices; 
5 S, G, SG Designation 



The rapid 
of 10 i .u. 



intravenous administration 
with . 4. • °^ oxytocin to a patient 
with uterine atony will cause all 
but oneof the fonowtng: 

Hypotension within 30 seconds 
Bradycardia wifliin 30 seconds 
Changes in EKG specificany 
flattening of inversion of 
T waves 

Tetanic uterine contractions 

within 30 seconds 
Uterine contractions that 
for about 3 minutes 



a 

b. 

c, 



Correct Answers,- Annotations* 
and References 



ati on 



The intravenous administra- 
bolus of 10 i.u. of oxytocin 
a severe reaction in a patient 



pars i s 



signation 



SG 



1 0W1 ng 
concerni ng 



of 



Al 1 but one of the 
statements are true 
oxytocin: 

a. It is an octapeptide 

b. It has-a biological half-life 

approximately three minutes 

c. When administered by constant 

infusion in a dose not exceed, 
ing 200 mu per minute It has 
no demonstrable effect on the 
cardiovascular system. 

d. It produces an elevation in 

serum nonesterl f i ed fatty adds 
fi' It is only stored and not 

synthesized in the posterior 
pituitary, 



ti on of a 
may produce 

in shock from postpartum'hemorrhQge'due 
to accentuation of the hypotension and 
thrhSnnl* tacchycardia. -The exten? of 
the hypotension and the recovery time 
varies with the dose administered A 

irrnfff^nf = "^^^ tip the balance 

in a patient who is mjepardy due to shock. 

Refer ences : 

and Kaiser, I.H 
11:360. 
and Brenner, W. e 
Gynec. 108:761. 
Shearman. R.p. (1956), 



Hergquist, J.R. 

dbstet. Gynec 
Hendricks, C.H. 

Am. J. Obstet 
Mayes, B.T. and 



(1 959 ), 
(1970), 



J 



Obstet. Gynaec. Brit, 



Comm. 63:812, 



no 



ir.C. 
.ati on 



ignation : s 



^ Administration of oxytocin 

intramuscularly, subcutaneously or by 
dilute infusion (not in excess of 20 mu 
per minute) rapidly increases uterine 
activity without any accompanying cardio- 
vascular response. 
References ; 

^"wV^MQ^,^"n^J■"• Dannenburg, 
rnh iK^^-b Ol^stet. Gynec. 21:708. 
Coch, J.A., Brovetto, J., CabofTH.M 

09 5 ''A.'-'i 'Sk^ Caldeyro-Barcia -R. 
(1965), Am. J. Obstet. Gynec 

Hendricks. C.H. and Brenner. W 



Am. J. Obstet. Gynec. 
Sachs , H. , Fawcett, p. ' 
Portanova, R. (1969), 
Res. 25:447. 



108: 751 



11:10. 
E. (1970), 



Tak aba take 
Rec. Prog. 



, Y. and 
Horm. 



^ Sample Sel f-Assessnient Questio ns 

I Journal (ploase type) American Journal of nhqetrlcs and Gynecology 
" ""'''''^ '''''' - Cardiovascular Effects of nxy tocic Drugs P..f 



I 



Senior ^^uthor: Charles H. Hendricks. M.D 



Publication Date 11/ 1/70 



In tho space below ploase type multiple choice auP^ti^^B ^ a 
'^ro. the article ns.oa Q.c^.ionfan" J„"s°::r;,:o°jL\".=::n fp™!^ 



the Icfthand column; correct answ 
fin the rlghthand column. Indlcat 

I gcneralist^applicabU, or applicable to both groups by putting a 

.Boston: MaLn^Ls^ '''' °' ''''' ^etu^n to%r 



rs annotations and references should appear 
whother a questions is s pec i a 1 i s t = app 1 i cab 1 o , 

"S", "G" or 
30 The Fenway, 



Questions 
6 S, G, 



; Answer Choices 
SG Designation 



a 
b 



The commonest indication for the 
prophylactic use of oxytocics in a 
postpartum patient is: 

Patient has severe pre-sclampsi 
Pregnancy complicated by 
pyel onephri ti s 

c. Pregnancy complicated by heart 

disease 

d. Patient delivered under general 

anesthesi a 

e. Breech delivery 

Designation: S, SG and G 



Correct Answers; Annotations' 
and References 



ti on 



The term 

both oxytocin and the 
the latter should not 
pre-ecl ampsi a as • they 
hypertenston. By far 



oxytocic includes 
ergot derlvativo, 
be used in seven 
accentuate the 
, the commonest 

etTology of postpartum uterine atony is 



use of general anesthesia, 
References : 



and 



the 



Oxytocics are administered to the 
postpartum patient after prolonged 
labor or pregnancy complicated by all 
one of the fol lowing: 

Polyhydramnios 
Large baby 
Twins 

Partial abruptio placentae 
Pulmonary edema 

Designation : SG and G 



but 

a 

b, 
c . 
d. 
e, 



TiTrrTeTT.W. (1 963), Brit. Med. J. 1:585, 
uomca, J.J.: in Principles and Practice 
of Obstetric Analgesia and Anesthesia, 
F.A. Davis Co., Philadelphia, p. 320 
Hendricks, C.H. and Brenner, W.E. (1970) 

Am. J. Obstet. Gynec. 108:751 
Ringrose, C.A.D. (1 962 ), Canad'. Med. 

Assoc. J. 87.712. 
Theobald, G.W7 (1968), Obstet. Gynec 
Survey, 23_:109. 

Answer^E. , . 

Annotation: It is well established that 
postpartum hemorrhage is more frequently 
encountered in the grande multipara, also 
in overdistension of the uterus, (multiple 
pregnancy, polyhyd ramni os , large baby) and 
following antepartum hemorrhage. Therefore 
prophylactic oxytocics postpartum are 
Indicated. On the other hand in the 
presence of pulmonary edema and cardiac 
disease they are contrai ndi cated . 

erences: 



ERIC 



Hendrfcks, C.H. and Brenner, W.E. (1970 ) 
Am. J. Obstet. Gynec. 108:751 

Theobald, G.W. (1968), OFsTet. Gynec. 
Survey 23: 1 09, 
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Journai (please type) 
Article Title 



Sample S elf -Assess ment Questions 



JM£lca^Journa1 of Qh.t.f.^r. nynrrMm-^ 



i 



Senior Author 



S. C. MacLeod 



Publication Date 11/1/70 



In the space below pleaie type multiple choice aup^ti^r. 
from the article listed aboTfT Questions and «n ? answors generated 

the lefthand column- correct answers anLt;tiLT"/'°i^ '^^""'^ ^oar in 
in the righthand column. Indicatrwhother a cue ti " ^PP^" 
generalist.applicable, or applicable to'SHh^Jo ^bf pittiSr^^P'^^P^'^ 



1 



Questions' Answer Choices; 
S, G, SG Designation 



i If a patient has amenorrhea 
Jypothalanilc origin and no FSH 
clornphene is ineffective. 

leslqnation: SG and G 



of 

excretion 



I 



Secondary amenorrhea and gal 
live been associated with all 
|F the following: 

a. Reserpine therapy 
Acromegaly 
Progestogen therapy 
Myxedema 
Tranqui 11 zers 

)Signation : S, SG and G 



ctorrhaa 
one 



Correct Answersi Annotations- 
and References 

Answer .- True 
Annotatlonr The presence of FSH 1 «; 
important for follicular maturation and 

an'in?act'hr"J^'i°"^ thrabsencfof 
an intact hypothal ami c-pi tui tary axis 
clomiphene is Ineffective. 
References • 

MacLeod, S.C. , Mitton, D.M 

and Tupper, W.R. C. (1970), 

G^nec. 108:814. 
Mahesh, YTF. and Goldman, B.D. (1971) In 

Proceedings of the Third Interna? i onll 

Congress on Hormonal StemiH ' fh. - ' 

V.H.T. and Martin, ' — 

Amsterdam, p. 662 

P|f,'H^-^ F«^9in«. Lipsett, M.B. 

Horm, 



Parker, A.S 
Am. J. Obstet, 



James 
Medica . 



uj P.I.. , Marshall, j.R.. strott 
and_Rodbard, D. (1^70 ) , " Rec. IJog, 



b, 
c. 
d. 
e. 



ERIC 



Answer : D. 

Annotation: Tranquilizers, certain anti- 

Hypertensive agents and exogenous stero 4 

may suppress the prol acti n4nhib1 11 Jg 

"srys!cifim?r§^j??of:°^"^-^--^^- 

References : 

Shearman, R.P.' (1968), Lancet 1;325. 



Sample Self-Assessment Quest ions 



I Journal (please type) American Journal of Obstetrics and Gynecology 
Article Title — Experiencft wit-h inriurtin p of ovuiatinn 



Senior Author: S. C. MacLeod Publication Date 11/1/70 

In tho space below please type multiple choice questions and answers generated 
frojii the article listed above. Questions and answer choices should appear in 
the lefthand column; correct answers, annotations and references should appear 
in the righthand column. Indicate whether a questions is specialist-applicable 
generalist-applicable , or applicable to both groups by putting a ^'S'' '*G" or ' 
*'SG" in the margin to the left of each question. Return to PMI 30 'rhe Fenway 
Boston, Mass . .02215 , ' ^ ' 



Questions^ Answer Choices; 
5 S, G, SG Designation 



Gonadotropin therapy for the 
induction of ovulation 1n order to 
avoid ovarian hyperstlniul atlon should 
I be monitored by daily changes in* 

i a. Cervical mucus 

b. Vaginal cytology 

1 c Ovarian size 

I d* Urinary pregnanediol 

e. Urinary estrogens 

Jesignatlon : S and SG 



Correct Answers| Annotations* 
and References 



Answer E. 

Annotation: The determination of 
estrogens prior to the administration of 
HCG is effective as a method to predict 
and thereby circumvent the ovarian hyper- 
stimulation. If the total estrogens do 
not exceed ISOyg per day the eventuatlon 
of this iatrogenic condition 1s negligibia 



References : 

Brown , Q, , Evans , J. , 
Tafe , H. P. and Townsend 
J, Obstet. Gynaec, Brit. 
Engel , T, , Jewelewici, R. , 

Speroff^ L, and VandeWiele', R.L. 
Am. J. Obstet. Gynec, 11 2:1052. 
MacLeod, S.C, Mitton, P.M., Parker, A.S. 
and Tupper, W.R.C, (1970), Am. J. Obstet 
Gynec, 108:814. 

M. 5 Yu ssman , 



Adey, F.D. , 
, L. (1969), 

Comm. 7^:289, 
, Dy ren f urth , I . , 
(1972), 



Ta 



M, and Gmi nski , 
(1970), Fertil, and Steril . 21:759. 



Journal (please type) 
Article Title 



American Journal of Ob stetrics and Gynecology 



Suppurative pelvic thrombophlebitis 



] Senior Author: Conrad G. nnllin^ 



Publication Date ]]f]/7() 



In the space below please type multiple choice aues t i nti = ' ar,^ 
from the article listed abHv^ Ouestion^ anl and answers generated 

the lefthand column; eorrecranswerf anLtaJio^fn^^ 

in the righthand column. Indicate whetherrqueLions i!"'"'"^ ^PP^" 
gcnoralist^applicable, or applicable to ^llh' ^^1^1'^' ^d^l^'s^'^m^^ 
BoJto MaL'^l22ir '''' °' '''' Return to Imi. o 'th P^Lay. 



Que s t i ons 
5 S, G, 



Answer Choices 
SG Designation 



The least important of the collateral' 
for the venous return from the pelvlB 
subsequent to ligation of the inferior 
vena cava and the ovarian veins are: 

a. Intervertebral venous plexus 

b. . Lumbar venous plexus 

c. Hemorrhoidal plexus and 

vertebral azygos 

d. Superficial and deep vein's of the 

abdominal wall 

Designation : S and SG 



Correct Answers* Annotations* 
and References 



Answer D. 

Annotation: There is a good anastomotic 
plexus of veins in the pelvis as 
evidenced by the fact that normal 
pregnancies frequently ensue following 
ngation of the inferior vena cava and 
ovarian veins. 

References : 



Ligation of the inferior vena cava 
and the ovarian veins usually results 
in: 

a. Amenorrhea 

b. Menorrhagia 

c. Anovulation 

d. Infertility 

e. Normal ovarian function 

Designation : S, SG and G 



Col 1 1ns, C. G 
Surgery 30_ 
' ^ i ns , C , G 
Gynec. 108 
Reid, D.E 

(1972), Principles 
lan 



and Ayers , W. B. (1 951 ) , 
319. ^' 

(1970), Am. J. Obstet. 
:681. 

Ryan, K.J. and Beni rschke , K. 

and Management of 
Reproduction, W.B. Saunders Co., 
adelphia, p. 695. 
Robinson, L.S. (1949), Surgery 25:329. 

Answer E. 

Annotation: In pregnancies subsequent 
this operative prodedure the patients 
have no more complications than those 
where no pelvic venous ligation had been 
performed. 



tc 
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New 



(1959), 

(1970), Am. 

Sreenivas, V 
Eng. J. Med, 
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J. Obstet. Gynec 
J. Obstet. Gynec 
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^Article Title 
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„ Supperqtive Pfflvir th rnmhnphi chu^ s 



Senior Author: 



Conrad G. Col 1 ins 



Publication Date 



11/ 1/70 

i n thD space below plaase type multiple choice auaqtinn^ ^rsA 

i:rom the article listed abSffr Questions ani 'nlwerch.'s should S^nerated 
the lefthandrcolu.n; correct answers, annctationrand -terLces ihouff" " 
n the righthand column. Indicate whether a questions J appear 

or applicable to both g^ouprb^pu t nf r's^-^P^ir'^^* 
.Boston! MaL^^ia^lS^ '''' °^ '''' ^^ '^^ 3o'The PeLay, 



Questions,' Answer Choices; 
fi S, G, SG Designation 



5 Suppurative pelvic thrombophleblti 
..s usually limited to the uterine 
vei ns . 



designation : SG and G 



Correct Answers; Annotations* 
and References 



Ahswer. False 



Annotation: Supperative pelvic thrombo- 
phlebitis IS frequently a difficult 
diagnostic problem and has to be differen- 
tiated from other pelvic infections 
There may be an irreguTar septic fever and 
abdominal examination may elicit tenderress 
along the course of the ovarian veins 
Autopsy studies have revealed involvement 
of the ovarian, ileo-femoral and 
hypogastric veins. 



Am 



Gynec 



Re ferences : 

brown and Munsick, R.A. (1971) 

Obstet. Gynec. 109:263. 
Collins, C.G. (19707, Am. J. Obstet 

108 : 681 . 

Montalto, Block, Malfetano and Janelli 
(1969), Obstet. Gynec. 34:367. 

^s]?' D-E'i Ryan, K.J. anr^Beni rschke , K. 
(1972), Principles and Management of 
Human Reproduction, W.B. Saunders Co., 
Philade^hia, p. 695. 



Sample - Self --Assessment Questions 
Journal (please type} Annals of Surgery 

Article Title Thickness, Cross-Sectional Ar eas and Depth of Invasion In thrPrognosis 



of Curanfioti.^ M^Tapnma 



Senior Author: _Maxand.. 



Publication Date Nov, 



1970 



In the space below please type multiple choice aue^tin«= j 

from the article listed Questions and «^=w \ answers generated 

the lefthand column; correct answer Annotations an'd1°J"' "PP«^^ 
m the righthand column. Indicate whetheffquLtions xs so^^ "PP"^" 
"Sp'iilhrSP'''''-'' r ^PPli"bl« ^° both gJoSp^brp; tin? 
B to M s'^l^^lf ^ 



^ * - o ^ 'S'S '*G" or 
Return to PMl, 30 The Fenway, 



Questions r Answer Choices 
6 G, SG Designation 



Correct Answers| Annotations* 
and References 



) 1, 



Prognosis of cutanaous melanoma appears 
to be a function of* 
tumor siEe 
extent of invasion 
anatomic location 
all of the above 



A, 



) 2. 



Useful adjunctive therapy for advanced 
melanoma is: 

As Regional perfusion with 5 F^u, 
B, Regional perfusion with pheny lalanihe 
mus tard 

Corticosteroids 
D, Irradiation 



Reference: SchwartE, S,, TeKtbook of 



Sur 



-ieyy > McGraw Hill, 1969, p." 399" 



Melanomas I 

A, are frequently seen in Negroes 
are common before puberty 
are often associated with pre- 
existing compund nevi 
have been reported to spontaneously 
regress 



Reference I Ibid 



Ibid, , p, 399, 



I 
I 

i 

I 



Journal (please type) 



_Sample Self ^Asses sment Questinn^ 
Annals of .q urgery 



-°°arpl °f infection .fr.. T>.„ -a^ a.culaVsura.ry" 



Senior Author- Joseph S, Carey, M.D. 



Publication Date ^ov., I97O 



Boston, Mass, 0221S. " question. Return to PMI, 30 The Fenway, 



Questions i Answer Choices; 
fl S, G, SG Designation 



(S)l,The preferred antibiotic ragimen^-to 
prevent endocarditis following cardio 
vascular surgery is: 
A.I.Vg PeniclLlin and Methiclllin 
' B«I^M, Penicillin and ScraptomyeiM 
Cel^Va Amplcillin 
D,I,M, Penicillin and Methicillin 



2, The most common organism found in 
wound infections, following cardio- 
vascular surgary is* 
Ab Staphylococcus 

B, Straptococcus 

C, E,coli 

D, Pseudomonas sp, 

(S)3,Tha incidence of postoperativa wound 
infattion in patients undergoing 
major cardiovascular surge^^ involv 
ing cardiopulmonary bypass is^ 

A. Lowar than in patients not Under- 
going cardiopulmonary bypass 

B. About 7% 

C. Unrelatad to bank blood 
' About 1% 



Correct Answers| Annotations* 
and Referencas 



A^ Prophylactic regimans of intramuscular 
antibiotics have been ineffective in 
reducing the incidence of postoparative 
endocarditis, Intra«nd post-oparative 
administration of 1,7, penicillinase 
resigfcant penicillins has resultad in 
zero cases of endocarditis among 216 
consecutive patients, 



A, In this series, 40% of infeetioni were 
secondary to staphylococcus aureus or 
albus species. 



Wound infections were encountered in 6.9% 
of patlenti undergoing cardiopulmonary 
bypass and in only 1,5% of patients In the 
non-bypass group. About 1-2% of units of ' 
bank blood have been shown to contain " 
bacteria, principally staphylococci and 
diptharoids. 



Journal (please type) 



Sample Se 1 f -As s essmept Questions 



I 

V Article Title Jo;;^^^a^^^;^J^,t io„ of ligation and Partial Interr uption of the 

f 



-Ttikjlfl ur burgery 



Senior Author; Tamao t aj . 

- ^JamB fl T. Ad.m., M Tl Publication D ate ^ -.^^^ 

Boston, Mass. 02215. question. Return to PMI, 30 Th^ Fenway, 



Questionsj Answer Choices 
S S, G, SG. Designation 



(S) 1, Significant staele cdmpllcationi 

following ligation or plication of 
inferior vena oava are generally 
thought to be secondary to: 
A, The level of the ligation or 
plica tion 

B^The aeverity of pre-existing venoJa 
disease ^ 

C^Inadequate post-operative antl- 
coagultion 

D^Inadequate poet-opera tlva external 
eupport 



Correct Answers| Annotations^ 
and References 



The status of the venous colla^^i,nls largely 
d^[:nrmlnas C'le vanous" return , and if these 
are pccludid by pre-eKleting phlabltl^, 
siaHLeUanC stasis oh^ty^s will r.iiult, 
reaairdlass of the other factors* 



(G,S^)2. Poatpperatlvi anticoagulation la 

usually adratnistered after inferior 
vena cava llgatinn or plication in 
order to* 

Agprevent further propagation of 

pre-existing thrombus 
B.Lyse pre-existing thrombus 
C^Lyse occult putoionary emboli 
D^None of the above 

(S)(G)3, Indications for ligation or pllcatior 
the Inferior vena cava are: 

A, A solitary Instance of pulmonary 
embolism 

B, Platelet count more than one 
million when antlcoagultlon la 
contra Indicated 
Superficial venous thrombosis 
when anticoagulation Is contra- 
indicated 

D^Resldual thrombi In the calf or 
femoral veins, following vanoui 
thrombictoLiiy 



A, Heparin is not a fibrinolytic compound^ and 

is therefore incapable of lysing formed 
■ thrombus. The venoua stasia ereated by cival 
ligation my cause aKtenslon of pre-eKtstitig 
thrombus ' proKlmally, oceludlng collateral 
venous trlbutarlis, aggravating the venous 
stasis syndrome. 
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of 



Although some studies have reported a 30% risk 
of recurrence with a 18% mortality following 
a solitary pulmonary amboluSj most surgeons 
prefer to wlthold cava! Interruption until ' 
after a second embolus occurSi or If a contra- 
indication to anticoagulation arises. Hyper- 
coaguabla states can be Mnaged with agents 
such as Dextran, and superficial venous 
thromboais Is a very rare cause of pulmonary 
embolism* Residual thrombi p howtwoi:'/ uPten 
break loose and embollie poat-operatlvely, 
even with adequnt^ .inti-coagulaW^i^i, and ' 
a^e an indication for cava! Interruption. 



I Sample Self-Aisessinent Questions 

Journal (please type) ^^,, 

1 Title EVALUATION OF A METHOD FOR RECONSTRUCTI ON OF THE ESOPHAGOGASTRIC JUNCTION 
AND THE APPLICAT ION TO ACHALASIA ^ ' 

Senior Author: Isuyoshl Hirashlma, M.D. 



i 
1 



Publication Date Nov. 1970 



In the space below please type multiple choice auestlnn^ 
from the article listed abovi" Questions J^H questions and answers generated 
the lefthand column; correct answers ^nL^,?- "."""^"^ Wear in 

in the rlghthand ^oiu^'^' ll^rkel^VT^.t^^t^l^^ ^^^^^ 

"Ic-^nir^PP''"''^' °' applicable to both gJouprb^putt ?r"^s""^P''"^ 

^6 in the margin to the left of each au^qfiSn d ; P^^^^ng a. 6 , ' g" or 
Boston, Mass. 02215. question. Return to PMI , 30 The Fenway, 



Questions I Answer Choice* 
S Sj Gj SG Designation 



Correct Answers | Annotatitms*, 
and References 



(1) The goal of surgical treatment of 
achalasia is? 

(a) Create a new gaetroesophageal angle 

(b) Keep the stomach below the diaphragn 
Cc) Dilate the lower esophagus without 

damaging physiologic function, 
(d) Prevent refluH esophagitis 



The authors sttess that the patch 
originate with a wide base from 
the (a) stomach, (b) esophagus 
becausei 

This prevents esophagitli 
A wider opening is obtained 
(e) The stomach wall has a good blood 
supply 



As the major pathological changa 
In achalasia is obstruction, its correction 



received first priority. 



(e) 
(d) 



as d The stomach patch is used to 
insure a wider opening. 



(3) Postoperative refluK can best be 
measured byi 

(a) Biopsy 

(b) Esophagoscopy 

(c) X-ray 

(d) Pressure and pH changes 



d Though the other methods are 
acceptable, pressure and pE change provide 
the most rellabia method. 
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p sample i»e i t-Assessment QuestioTis 

Journ-ai (please type) AHnALS OF SURGERY 



I Artic]e Title SURGICAL TREAmENT OF CHOLEDOCHAL CYST 



I 



Senior Author: Morlo Kasal. M.D. 



Publication Date Nov. 1970 



I 



Boston, Mass 0221" ' ""urn to PMI. 30 The FeLay, 



G.S, 



Questions* Answer Choices j 
fi SG Dgsignation 



Correct Answers | Annotations* 
and References 



(1) The most satisfactory surgical 

procedure for choledochal cyst is; 

a, ) Internal drainage of the cyst 

b. ) Resection of the cyst with Roux-en^ 

f hapatlcojejunostomy 
c) Resection of the cyst and recon-^ 
struction of the common duct 



(2) In addition to upper G.I, series 
a useful diagnostic aide is: 

a. ) Oral cholecyatograra 

b. ) Intravenous cholangiography 

c. ) Hepatic biliary scintigram 



(3) Postoperative problems include: 

a. ) Stone formation 

b. ) Anastomosis stricture 
c) Reflux infection 

d») Cirrhosis 



b Resection^ coupled with Internal 
drainage, offers the most satisfactory method 
of therapy. 



c Hepatic biliary scintigram is 
vary useful in depicting the cyst. 



' ^ Stricture is a commoa 
complication following biliary surgery. The 
author also reports a high incidence of 
reflux Infection. Though this was common 
argument against the use of choledochoduode- 
nostomy in adult, it has not proved to be 
the case. It Is usual then to see such a 
high incidence In these cases. 
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Sample Se lf-Assessment Questions 
I Journal (please type) Surgery Gynecology and Obstetrics 

Article Title Epidermoid Carcinoma of the Anorectum 



i 



Senior Author: Maus StearnB^ 



In the space below please type 
from the article listed above" 
the.lefthand column; correct 



Publication Date 



1970 



multiple choice questions and answers generated 
Questions and answer choices should Innelfif 

the righthand column ^ndic^t rwhet^affar^ ihould appear 
generallst = applicable, or appli"bi% to bo^h ^"^^tif^Vis specialist-applicab le 
"SG" in the mariln to the left ^° b°th groups by putting a "S-, "g" or 

Boston. Mass 0221S -^'^ Return to PMI ' " 



tf ton 



30 The Fenway^ 



Questions* Answer Choices; 
■ S SG Dasignation 



Of carcinoma occurring, within the last 
18 centimatars of alimentary tract the 
^ approximata parcentage being epidermoid 
will be: 

A) less than 1% 

B) 2%.. 

C) 10% 

D) 20% 

The appearance of Inguinal node mata^ 
atases following resaaction for epider- 
moid carcinoma of the rectum is^ 
A) associated with a 75% 5 year survival 
rate 

= B) associated with a 50% 
rate 

C) assQciatad with a 20% 
rate 

D) associated with a less than 10% 
5 year survival rate 

The operation of choice for a small epi- 
dermoid carcinoma not penetrating the 
sphincter is: 

Abdominal perineal with prophylactic 
inguinal node dissection 
Abdominal perineal with therapeutic 
node dissection 

Wide local eKcieion with prophylactic 
node dissection 

Wide local excision with therapeutic 
node dissection 



year survival 
year survival 



B) 
C) 
D) 



Correct Answersi Annotations^ 
and References 



By including a large number of colon 
cancers, the incidence of epidermoid 
carcinomas becomes quite los. If we 
consider only those carcinomas occur- 
rLng m the distal 2 cms., then 30% 
will be epidermal. 



Unlika the occurranca of nodal metastases 
at the time of diagnosis, late metastasis 
carry a. very high 5 year survival rate 



According to' the authors' study wide 
local excision is the primary treatment 
of choice in this type of lesion. Thera- 
peutic node dissection is favored because 
only about 10% at most would have benefited 
from prophylactic node dissection 



Sample Sal Assessment Questions 



Journal (please type) Surgeyy gynecology and Obstat 



rics 



Article Title Total Circulating Albumin Deficits Q. 




Senior Author 



f^of:h:''ar:i = t.'°u^;:r:b^^ ""JSarJ-o""".' q-stions and a„s».., generated 
m the righthand colMn. Indicate whether a guestion/if !n^^ ° , • ? '^P'" 
m MaL""o'221 ? °' '° 'o'lhe Fe"„a,, 



Bos t on 



Questions* Answer Choices; 
9 S^ G, SG Designation 



1* The causa of postoperative hypoprotein- 
enimia Is felt to be due to- 



Correct Answers^ Annotations' 
and References 



Decreasad Albumin production 
Increased Albumin Piuduction 
Increased Capillary Permeability 
External Loss 



A) 
B) 
C) 
D) 



Protein lost through nasogastric suction 
in uncomplicated cases is: 

A) Negligable 

B) 1 gram per day , 

C) 5 grams per day 

D) 10 grams per 



B) 
C) 



A mean total exchangeable albumin deficit 
of 30% represents a net loss of: 
A) 20 grams albumin 
40 grams albumin 
60 grams albumin 
80 grams albumin 



Hypoproteinanimia is felt to be due to 
decrease in the size of the circulating 
pool secondary to an extravasation of 
albumin into the extravaicular space. 



Though gastric losses can approach 5 
grams per day in cases complicated 
by gastrlotomy and paralytic ileuSj 
the normal loss is 1 gram per day/ 



The total exchangeable albumin Is 
about 4 grams/kilogram. In a 70 
kilogram man, this represents 280 
grams of albumin, A 30% deficit 
would represent a loss of approxi- 
mately 80 grams 



Sample Self '-Assessment Questinns 



I 
I 



Surgery Gynecology and Obstetric.^ 



Journal (please type) 
Article, Title RoenteBnograDhtn F!v.lM.tion of Traum.M.c Rupture nf A^.^. 



Senior Author: Marvin Kirsh^ M.d/ 



Publication Date 



i 



In the 



space below please type multiple choice aueqtTnTi^ ^t,^ 

llTle^i^^^'l aboTfr Questions and ^n^w^J^choices^s ouH 

the lefthand column; correct answers, annotations and ref erencerih m^f 5 
m the rlghthand column. Indicata whether a questions 1^10""^?^^^^^ 
generalast^applicable. or applicable to both groups brpitti^ra "S'- "P or ' 

BoJtoJ! M^^'l^d' - ' " 



30 The Fenway^ 



4. 



Questionsi Answer Choices^ 
S S, G, SG Designation 



Acute rupture of the thoracic aorta 
secondary to trauma Is associated with 
immediate death in: 

A) 100% 

B) 90% - 80% 

C) 75% - 50% 

D) less thaii 50% 

In this papery rupture of the aorta was 
always associated withj 

A) evidence of chest trauma 

B) deviation of the trachea 

G) deprasaion' of left mainstem bronchui 
D) widening of mediastinum 

The natural history of pseudoaneurysm 
of the thoracic aorta Isi 

A) spontaneous regression 

B) rupture within 1 to 4 weeks 

C) rupture within I to 4 months 

D) insignificant to survival 

The area where most lacerations of the. 
thoracic aorta, secondary to trauma, 
occur iSi V 

A) Just distal to the ductus arteri- 
olosus 

B) Ascending aorta 

C) Transvarse aorta 

D) Junction of subclavian with aorta 



Correct Answers^ Annotations? 
and References 



B, The formation of pseudoaneurysm prevents 
the immediata mortality from being 100%/ 



Though the other findings are 
important diagnostic considerations, 
only widening of mediastinim was 
present in 100% 



B, Because of the rather '^flimsy" 
adventitial structures around the 
ruptures, these pseudoaneurysms 
usually rupture within 1 month, 



Though not alluded to in this article, 
rupture usually occurs Just distal to 
the Ductus, This area is fairly well 
secured to the vertebral column and 
abrupt decelaratlon tears the descending 
aorta at this spot* 
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k , Sample Self -Assessment Questinnc 

jJournM (Please type) 



I 
I 

I 
J 
I 



Article Title COMPLICATIONS OF TOTAL THYROIDECTOMY FOR 



CARCINOMA 



Senior Auti.or: Norman W. Thomp snn, m 




.A.C.S 



PubjAgatlon DateNnvAmha^iQ7n 



Bo.r.r M """Sm to the left of each question 
ooston^ Mass. 02215 H^^^t-j-on 



Return to PMI , 30 The Fenway, 



Questldnsj Answer Choices 
6 S, G, SG Designation 



S-G, (1) 
b.) 



The raason for advocating total 
thyroidectomy In carcinoma of the 
thyroid are: 

It decreases the chance of recurren 
nerve injury. 
There is often cQntralateral lobe 
and Isthmus Involveraent s 
It facilitates radio active iodine 
evaluation and treatment. 
Since the parathyroids are identi- 
fied, hypoparathyroidism doesn^t 
occur. 



Correct Answers^ Annotations? 
and Referances 



b| & The chancea of recurrent 
nerve injury are probably greater secondary 
to surgery than to infiltration by cancer. 



(2) Arguments agalnit total thyroid- 
ectomy arise because of the 
following complications I 

a. ) Hypothyroidism 

b. ) Hypoparathyroidism 

Cp) Recurrent laryngeal nerve Injury 

d») Tracheostomy 

e.) Significant mortality 



(3) Hypoparathyroidism may be treated 

with I 
at) Oral calcium 
bO I. v. calcium 
c) Oral vitamin D 

d. ) I.V, vitamin D 

e. ) Oral parathoraone 



b, & Hypoparathyroidism, .In contrast 
to hypothyroidism Is very difficult to manage 
Unilateral recurrent nerve injury is bad 
enough; bilateral injury is disastrous. 



a, bj & c. Hypoparathyroidism is 
adequately managed by these three agenti 
There is no need for the other methods. 



P Sampla Self -Assassment Questi ons 

Journal Cplease type) SURGERY. Gyne&olQty 4 Obstetrics 
' Article Title SURGICAL MANAGEMENT OF CUTANEOUS LYE BURNS 



1 Senior Author; 



F. G. Wolfort. M.D. 



In 



Publication Date Nmr 



1970 



I 



m the righthand column. Indicate whether n n,,*.*^ rererences should appear 



Questions; Answer Choices; 
6 G, SG Designation 



Correct Answers; Annotations* 
and References 



G*S. (1) Lye burns are (a) less severe 

(b) more severe than thermal burns 
bacause lye: 
8*) Saponifies fat 
dO detracts water 
a,) Forms alkaline protenatea 
fO Generates heat 



(2) Treatment of lye burns IncludeaJ 

(a) Topical antiblotice 

(b) Washing with hescacloraphene 

(c) Tub baths 

(d) Frequent or continuous showers 



(3) Peculiar complications of lye burns 
are: 

(a) Tympanic membrane perforationi 

(b) Pasfbtid cutaneous fistulas 
^(c) Alkalosis 

(d) Shock due to fluid loss 

becauaa of: 

(e) An exothermic reaction 

(f) Most lye is swallowed 

(g) The liquid nature of most lye 



bi c, d, e, f 



All of thaie factors 



make lye burns partieulary dangarousp 



d One of the major considerations 
is dilution of the alkaline agent; this ia 
best achieved by shower. 



a, g The liquid nature of moat lye 
allows penetration into areas where thermal 
burn have little effects 
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